Apr 14 05:39:46 user devstack@n-api.service[61643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 05:39:46 user devstack@n-api.service[61643]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 05:39:46 2023] *** Apr 14 05:39:46 user devstack@n-api.service[61643]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 05:39:46 user devstack@n-api.service[61643]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 05:39:46 user devstack@n-api.service[61643]: nodename: user Apr 14 05:39:46 user devstack@n-api.service[61643]: machine: x86_64 Apr 14 05:39:46 user devstack@n-api.service[61643]: clock source: unix Apr 14 05:39:46 user devstack@n-api.service[61643]: pcre jit disabled Apr 14 05:39:46 user devstack@n-api.service[61643]: detected number of CPU cores: 12 Apr 14 05:39:46 user devstack@n-api.service[61643]: current working directory: / Apr 14 05:39:46 user devstack@n-api.service[61643]: detected binary path: /usr/bin/uwsgi-core Apr 14 05:39:46 user devstack@n-api.service[61643]: your processes number limit is 63637 Apr 14 05:39:46 user devstack@n-api.service[61643]: your memory page size is 4096 bytes Apr 14 05:39:46 user devstack@n-api.service[61643]: detected max file descriptor number: 2048 Apr 14 05:39:46 user devstack@n-api.service[61643]: lock engine: pthread robust mutexes Apr 14 05:39:46 user devstack@n-api.service[61643]: thunder lock: enabled Apr 14 05:39:46 user devstack@n-api.service[61643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 05:39:46 user devstack@n-api.service[61643]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 05:39:46 user devstack@n-api.service[61643]: Python main interpreter initialized at 0x5588c923a990 Apr 14 05:39:46 user devstack@n-api.service[61643]: python threads support enabled Apr 14 05:39:46 user devstack@n-api.service[61643]: your server socket listen backlog is limited to 100 connections Apr 14 05:39:46 user devstack@n-api.service[61643]: your mercy for graceful operations on workers is 90 seconds Apr 14 05:39:46 user devstack@n-api.service[61643]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 05:39:46 user devstack@n-api.service[61643]: *** Operational MODE: preforking *** Apr 14 05:39:46 user devstack@n-api.service[61643]: *** uWSGI is running in multiple interpreter mode *** Apr 14 05:39:46 user devstack@n-api.service[61643]: spawned uWSGI master process (pid: 61643) Apr 14 05:39:46 user devstack@n-api.service[61643]: spawned uWSGI worker 1 (pid: 61644, cores: 1) Apr 14 05:39:46 user devstack@n-api.service[61643]: spawned uWSGI worker 2 (pid: 61645, cores: 1) Apr 14 05:39:46 user devstack@n-api.service[61643]: spawned uWSGI worker 3 (pid: 61646, cores: 1) Apr 14 05:39:46 user devstack@n-api.service[61643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 05:39:46 user devstack@n-api.service[61646]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 05:39:47 user devstack@n-api.service[61645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 05:39:47 user devstack@n-api.service[61644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 05:39:50 user devstack@n-api.service[61645]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 05:39:50 user devstack@n-api.service[61645]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 05:39:50 user devstack@n-api.service[61645]: and ``live_migration_inbound_addr`` respectively. Apr 14 05:39:50 user devstack@n-api.service[61645]: ). Its value may be silently ignored in the future. Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 05:39:50 user devstack@n-api.service[61646]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 05:39:50 user devstack@n-api.service[61646]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 05:39:50 user devstack@n-api.service[61646]: and ``live_migration_inbound_addr`` respectively. Apr 14 05:39:50 user devstack@n-api.service[61646]: ). Its value may be silently ignored in the future. Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 05:39:50 user devstack@n-api.service[61644]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 05:39:50 user devstack@n-api.service[61644]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 05:39:50 user devstack@n-api.service[61644]: and ``live_migration_inbound_addr`` respectively. Apr 14 05:39:50 user devstack@n-api.service[61644]: ). Its value may be silently ignored in the future. Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61645) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61646) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61644) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 05:39:50 user devstack@n-api.service[61646]: INFO dbcounter [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Registered counter for database nova_api Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_db.sqlalchemy.engines [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61646) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61645]: INFO dbcounter [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Registered counter for database nova_api Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writer thread running {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_db.sqlalchemy.engines [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61645) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG nova.context [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04c347fb-2af4-49ec-9923-e49099926d59(cell1) {{(pid=61646) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 05:39:50 user devstack@n-api.service[61644]: INFO dbcounter [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Registered counter for database nova_api Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writer thread running {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61646]: INFO dbcounter [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61646]: INFO dbcounter [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Registered counter for database nova_cell1 Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_db.sqlalchemy.engines [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61646) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_db.sqlalchemy.engines [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61646) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_db.sqlalchemy.engines [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61644) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writer thread running {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writer thread running {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writer thread running {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG nova.context [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04c347fb-2af4-49ec-9923-e49099926d59(cell1) {{(pid=61645) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG nova.context [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),04c347fb-2af4-49ec-9923-e49099926d59(cell1) {{(pid=61644) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 05:39:50 user devstack@n-api.service[61645]: INFO dbcounter [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61645]: INFO dbcounter [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Registered counter for database nova_cell1 Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:39:50 user devstack@n-api.service[61644]: INFO dbcounter [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61644]: INFO dbcounter [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Registered counter for database nova_cell1 Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_db.sqlalchemy.engines [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61645) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writer thread running {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_db.sqlalchemy.engines [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61645) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_db.sqlalchemy.engines [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61644) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writer thread running {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_db.sqlalchemy.engines [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61644) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61646]: INFO dbcounter [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG oslo_db.sqlalchemy.engines [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61646) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writer thread running {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writer thread running {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61644]: INFO dbcounter [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writer thread running {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG oslo_db.sqlalchemy.engines [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61644) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writer thread running {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:50 user devstack@n-api.service[61645]: INFO dbcounter [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Registered counter for database nova_cell0 Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG oslo_db.sqlalchemy.engines [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61645) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 05:39:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writer thread running {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 05:39:51 user devstack@n-api.service[61646]: WARNING keystonemiddleware.auth_token [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61646]: WARNING keystonemiddleware.auth_token [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61644]: WARNING keystonemiddleware.auth_token [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61644]: WARNING keystonemiddleware.auth_token [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61645]: WARNING keystonemiddleware.auth_token [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61645]: WARNING keystonemiddleware.auth_token [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61646]: WARNING keystonemiddleware.auth_token [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61646]: WARNING keystonemiddleware.auth_token [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61646]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588c923a990 pid: 61646 (default app) Apr 14 05:39:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:39:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001605 Apr 14 05:39:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 05:39:51 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:39:51 user devstack@n-api.service[61645]: WARNING keystonemiddleware.auth_token [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61644]: WARNING keystonemiddleware.auth_token [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 05:39:51 user devstack@n-api.service[61645]: WARNING keystonemiddleware.auth_token [None req-a58aafe5-70c0-4a73-90e4-cb30f60fc18c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61644]: WARNING keystonemiddleware.auth_token [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 05:39:51 user devstack@n-api.service[61645]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588c923a990 pid: 61645 (default app) Apr 14 05:39:51 user devstack@n-api.service[61644]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588c923a990 pid: 61644 (default app) Apr 14 05:41:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:41:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-cf98aae8-2cce-4171-bfe6-e5a84dc5e2c6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001664 Apr 14 05:41:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:41:58 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:41:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:41:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:41:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:41:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:41:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-579c2f68-1ab1-4d36-90f6-cda6bf618f18 admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:41:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-579c2f68-1ab1-4d36-90f6-cda6bf618f18 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.440166 Apr 14 05:41:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 05:41:58 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002111 Apr 14 05:42:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:01 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:01 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:01 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:01 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:01 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:01 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3a77cdf9-5569-457f-be12-6a2533b0eae6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "id": "c1", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3a77cdf9-5569-457f-be12-6a2533b0eae6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.345916 Apr 14 05:42:01 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:01 2023] POST /compute/v2.1/flavors => generated 405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6fffcea0-f949-4093-83d7-839c07bfe982 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6fffcea0-f949-4093-83d7-839c07bfe982 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054056 Apr 14 05:42:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 05:42:01 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 14 05:42:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-56617e7b-17d1-4513-912f-8006071493cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-56617e7b-17d1-4513-912f-8006071493cf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076148 Apr 14 05:42:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:03 2023] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d40225eb-927c-44ed-a4ff-70e22ebb512a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d40225eb-927c-44ed-a4ff-70e22ebb512a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042867 Apr 14 05:42:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 05:42:03 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001437 Apr 14 05:42:05 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-66666636-c84c-43e2-8ab6-943a962259f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-66666636-c84c-43e2-8ab6-943a962259f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065224 Apr 14 05:42:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:05 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-46eab572-8cd6-46eb-a54f-1b939392fa34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-46eab572-8cd6-46eb-a54f-1b939392fa34 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032078 Apr 14 05:42:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 05:42:05 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001552 Apr 14 05:42:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:07 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b88511ec-a16a-4a80-bbdd-520e4b9513c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "id": "d3", "name": "ds2G", "ram": 2048}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b88511ec-a16a-4a80-bbdd-520e4b9513c5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081527 Apr 14 05:42:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:07 2023] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3c69cb79-8dc7-46a3-9cd9-0682688873ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3c69cb79-8dc7-46a3-9cd9-0682688873ec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024394 Apr 14 05:42:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 05:42:07 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001517 Apr 14 05:42:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:09 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c9a2aac0-2e49-4518-9d28-98fcee379a12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "vcpus": 4, "disk": 20}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c9a2aac0-2e49-4518-9d28-98fcee379a12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060282 Apr 14 05:42:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:09 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026069 Apr 14 05:42:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 05:42:09 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75442d58-2717-404a-aafe-291f51f0faa8 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001548 Apr 14 05:42:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0b7cc80c-abfe-445f-88c2-d8db243e3ac3 admin admin] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0b7cc80c-abfe-445f-88c2-d8db243e3ac3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.066445 Apr 14 05:42:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 05:42:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:42:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001753 Apr 14 05:42:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ba9e69ad-d892-40cb-84c3-0f6251239671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ba9e69ad-d892-40cb-84c3-0f6251239671 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.315235 Apr 14 05:42:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:13 2023] POST /compute/v2.1/flavors => generated 400 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-cdb87053-eb16-41ff-95ff-ab5b6bf6bf5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-cdb87053-eb16-41ff-95ff-ab5b6bf6bf5b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040387 Apr 14 05:42:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 05:42:13 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001614 Apr 14 05:42:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:15 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-25637176-d0f7-43a2-88f8-c00c3250a42c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "swap": 0}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-25637176-d0f7-43a2-88f8-c00c3250a42c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061785 Apr 14 05:42:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:15 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 05:42:15 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7bf30213-a362-4560-be57-bd2888f9a82a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7bf30213-a362-4560-be57-bd2888f9a82a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025517 Apr 14 05:42:15 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 05:42:15 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001442 Apr 14 05:42:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a923def8-71db-44b0-abfa-d63fe7e64f84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "vcpus": 2, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a923def8-71db-44b0-abfa-d63fe7e64f84 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068693 Apr 14 05:42:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:17 2023] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ba397324-0fa0-4af1-b81c-e08841cc9b7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ba397324-0fa0-4af1-b81c-e08841cc9b7b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024953 Apr 14 05:42:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 05:42:17 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001656 Apr 14 05:42:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7161ec30-3c6f-479e-b6b0-350e615125aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "disk": 80}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7161ec30-3c6f-479e-b6b0-350e615125aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.081407 Apr 14 05:42:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:19 2023] POST /compute/v2.1/flavors => generated 403 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-047e0cb5-c54e-4c0a-8d3b-095f387defc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-047e0cb5-c54e-4c0a-8d3b-095f387defc3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032841 Apr 14 05:42:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 05:42:19 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001555 Apr 14 05:42:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 05:42:21 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:42:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-0d35f7cb-5c5a-4cb2-b469-ccdd3027c138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-0d35f7cb-5c5a-4cb2-b469-ccdd3027c138 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086412 Apr 14 05:42:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 05:42:21 2023] POST /compute/v2.1/flavors => generated 406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:42:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e65cdc18-ee08-40e5-9086-a75e0782b5b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:42:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e65cdc18-ee08-40e5-9086-a75e0782b5b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026713 Apr 14 05:42:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 05:42:21 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:42:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e507ad30-eb17-429a-9311-275be5cfebdd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002677 Apr 14 05:42:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 05:42:57 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:42:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:42:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.097276 Apr 14 05:42:57 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 05:42:57 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:43:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e65cdc18-ee08-40e5-9086-a75e0782b5b4 admin admin] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:43:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e65cdc18-ee08-40e5-9086-a75e0782b5b4 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001895 Apr 14 05:43:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 05:43:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:43:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:43:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f297697c-cd01-40e4-aeec-6240970d4376 admin admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:43:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f297697c-cd01-40e4-aeec-6240970d4376 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.081789 Apr 14 05:43:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 05:43:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:43:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:43:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001643 Apr 14 05:43:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 05:43:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:43:33 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:43:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-49964390-7506-4b3a-bf4e-8a5d0cc71c7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.nano", "rxtx_factor": 1.0, "ram": 128, "vcpus": 1, "swap": 0, "id": "42", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:43:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-49964390-7506-4b3a-bf4e-8a5d0cc71c7a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.075143 Apr 14 05:43:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 05:43:33 2023] POST /compute/v2.1/flavors => generated 403 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:43:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-52255556-1cf7-4496-b51f-a30e86cedf72 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:43:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-52255556-1cf7-4496-b51f-a30e86cedf72 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032582 Apr 14 05:43:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 05:43:33 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:43:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:43:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8f5e4c55-9589-4449-9255-07a9346f011c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001415 Apr 14 05:43:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 05:43:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:43:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-56ef03c6-73ed-4389-b879-11ad590e2283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 192, "vcpus": 1, "swap": 0, "name": "m1.micro", "disk": 1, "id": "84", "rxtx_factor": 1.0}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:43:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-56ef03c6-73ed-4389-b879-11ad590e2283 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.063680 Apr 14 05:43:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 05:43:38 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:43:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e368f37c-65f5-4ff8-9dfe-deb81fcfc199 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:43:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e368f37c-65f5-4ff8-9dfe-deb81fcfc199 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024553 Apr 14 05:43:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 05:43:38 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:45:49 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:45:49 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:45:49 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:45:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-24076551-268f-424a-a411-669be0da70a6 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Action: 'create', calling method: .version_select at 0x7f55e3801510>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-737131205"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:45:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-24076551-268f-424a-a411-669be0da70a6 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.970252 Apr 14 05:45:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 05:45:49 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1972 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 05:45:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:45:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f45ce060-36e6-4121-8a64-c7a9d269a153 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e399b520>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f45ce060-36e6-4121-8a64-c7a9d269a153 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 344 microversion: 2.1 time: 0.421868 Apr 14 05:45:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:45:51 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 344 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:45:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3018e0b6-c47b-4346-b246-535169543a08 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3971900>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3018e0b6-c47b-4346-b246-535169543a08 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 345 microversion: 2.1 time: 0.294402 Apr 14 05:45:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:45:53 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 345 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-080871af-3891-4977-beb1-6fcdc15016da tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Action: 'create', calling method: .version_select at 0x7f55e38869e0>, body: {"snapshot": {"volume_id": "947da060-8356-4ad8-96d0-9d06304c73c4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1777446427"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:45:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-080871af-3891-4977-beb1-6fcdc15016da tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.260915 Apr 14 05:45:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 05:45:53 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5370f75f-1207-47ae-8b3d-4b91f20a9f2d tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e381b7f0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5370f75f-1207-47ae-8b3d-4b91f20a9f2d tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.070453 Apr 14 05:45:53 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:53 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c3454e40-409a-4391-9d46-fca650b08355 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3812ef0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c3454e40-409a-4391-9d46-fca650b08355 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059021 Apr 14 05:45:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 05:45:53 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-01c3e14e-4e38-414c-9536-d14fc8411c54 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3886a70>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-01c3e14e-4e38-414c-9536-d14fc8411c54 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.039834 Apr 14 05:45:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:53 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-35b48e73-eea5-46fc-b1a8-36702d0e345a tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e381bf40>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-35b48e73-eea5-46fc-b1a8-36702d0e345a tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.058810 Apr 14 05:45:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:54 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-25bbd454-6d9c-4ff1-8005-78c518ca129d tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3828310>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-25bbd454-6d9c-4ff1-8005-78c518ca129d tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 288 microversion: 2.1 time: 0.040404 Apr 14 05:45:56 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:55 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-151d0325-7e80-4978-a1d4-a57eec258fff tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3887010>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-151d0325-7e80-4978-a1d4-a57eec258fff tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 202 len: 0 microversion: 2.1 time: 0.097636 Apr 14 05:45:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 05:45:56 2023] DELETE /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:45:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-69d923cb-2fbf-411c-8f30-3f4bc50089d6 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e381b910>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-69d923cb-2fbf-411c-8f30-3f4bc50089d6 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.045549 Apr 14 05:45:56 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:56 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-04a34c17-6b0e-4954-a61d-d666b4b6667f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3813be0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-04a34c17-6b0e-4954-a61d-d666b4b6667f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.042769 Apr 14 05:45:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:57 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4294297d-a78d-49e2-a2e9-2249ab7d20bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3886830>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4294297d-a78d-49e2-a2e9-2249ab7d20bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 200 len: 287 microversion: 2.1 time: 0.049112 Apr 14 05:45:58 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:58 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:45:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a6af0de9-fd81-4754-a139-5a8bf558b0bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3838310>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-a6af0de9-fd81-4754-a139-5a8bf558b0bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] HTTP exception thrown: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. Apr 14 05:45:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a6af0de9-fd81-4754-a139-5a8bf558b0bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Request method failure captured: Apr 14 05:45:59 user devstack@n-api.service[61646]: request: GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 HTTP/1.1 Apr 14 05:45:59 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:45:59 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:45:59 user devstack@n-api.service[61646]: Connection: close Apr 14 05:45:59 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:45:59 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:45:59 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:45:59 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:45:59 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOiNr_ClZICrYm8vewRCL77HkHoIjOI1pp8tQiAsCg5TENt31LcXdG-YWJc6m8e4gfk4m3f3FByxCkyJ-sTeghryW_yKMK9WGSboLMgWp5Mq9ush2WkLwAZldI5T1JcLolrd41oOoxJ-CicsKDgZ-NSt_A6587khex0nglcOiefG-Jg Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Project-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e5425f990244837961b88def982a0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Tenant-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-User: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:45:59 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:45:59 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:45:59 user devstack@n-api.service[61646]: X-User-Id: e906ef8c66cd48d6b2274c860e9b7601 Apr 14 05:45:59 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:45:59 user devstack@n-api.service[61646]: method: Apr 14 05:45:59 user devstack@n-api.service[61646]: exception: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. Apr 14 05:45:59 user devstack@n-api.service[61646]: action_args: {'id': '18a039fa-d12e-45f3-91ef-253bf2696022'} Apr 14 05:45:59 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. (HTTP 404) (Request-ID: req-8586760b-2dbf-4eb4-b2b0-11874c2a89c0) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. Apr 14 05:45:59 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:45:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a6af0de9-fd81-4754-a139-5a8bf558b0bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Returning 404 to user: Snapshot 18a039fa-d12e-45f3-91ef-253bf2696022 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:45:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a6af0de9-fd81-4754-a139-5a8bf558b0bd tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022" status: 404 len: 111 microversion: 2.1 time: 0.035542 Apr 14 05:45:59 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 05:45:59 2023] GET /compute/v2.1/os-snapshots/18a039fa-d12e-45f3-91ef-253bf2696022 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:45:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a418f83d-51bf-45f0-a45f-5e9e740710f4 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3813490>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a418f83d-51bf-45f0-a45f-5e9e740710f4 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 202 len: 0 microversion: 2.1 time: 0.070870 Apr 14 05:45:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 05:45:59 2023] DELETE /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:45:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7f98a8fc-aa16-4665-871c-6076875bbd27 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3887b50>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:45:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7f98a8fc-aa16-4665-871c-6076875bbd27 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 344 microversion: 2.1 time: 0.056886 Apr 14 05:45:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:45:59 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f1387de0-304e-4fdf-b3b1-e324b4e9ce21 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3839120>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f1387de0-304e-4fdf-b3b1-e324b4e9ce21 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 344 microversion: 2.1 time: 0.074139 Apr 14 05:46:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:46:00 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ad85581b-e602-4b4e-a496-8cff620d6dd4 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3973520>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ad85581b-e602-4b4e-a496-8cff620d6dd4 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 344 microversion: 2.1 time: 0.075550 Apr 14 05:46:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:46:01 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b0c7a5fd-3dde-4746-9864-dbc8a4bddb55 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3886f80>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b0c7a5fd-3dde-4746-9864-dbc8a4bddb55 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 200 len: 344 microversion: 2.1 time: 0.055729 Apr 14 05:46:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:46:02 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c9c498e6-8f08-4923-a64c-39016e5ad81f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e38397e0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-c9c498e6-8f08-4923-a64c-39016e5ad81f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] HTTP exception thrown: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c9c498e6-8f08-4923-a64c-39016e5ad81f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Request method failure captured: Apr 14 05:46:03 user devstack@n-api.service[61646]: request: GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 HTTP/1.1 Apr 14 05:46:03 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:46:03 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:46:03 user devstack@n-api.service[61646]: Connection: close Apr 14 05:46:03 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:46:03 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:46:03 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:46:03 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:46:03 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOiNr_ClZICrYm8vewRCL77HkHoIjOI1pp8tQiAsCg5TENt31LcXdG-YWJc6m8e4gfk4m3f3FByxCkyJ-sTeghryW_yKMK9WGSboLMgWp5Mq9ush2WkLwAZldI5T1JcLolrd41oOoxJ-CicsKDgZ-NSt_A6587khex0nglcOiefG-Jg Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Project-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e5425f990244837961b88def982a0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Tenant-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-User: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61646]: X-User-Id: e906ef8c66cd48d6b2274c860e9b7601 Apr 14 05:46:03 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61646]: method: Apr 14 05:46:03 user devstack@n-api.service[61646]: exception: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61646]: action_args: {'id': '947da060-8356-4ad8-96d0-9d06304c73c4'} Apr 14 05:46:03 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. (HTTP 404) (Request-ID: req-886caac2-20a4-4d09-b08f-032367bc61f3) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c9c498e6-8f08-4923-a64c-39016e5ad81f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Returning 404 to user: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:46:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c9c498e6-8f08-4923-a64c-39016e5ad81f tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 404 len: 109 microversion: 2.1 time: 0.039160 Apr 14 05:46:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:46:03 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:46:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-45c45840-a362-4671-ab0e-aae650c4d650 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e3812f80>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-45c45840-a362-4671-ab0e-aae650c4d650 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] HTTP exception thrown: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-45c45840-a362-4671-ab0e-aae650c4d650 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Request method failure captured: Apr 14 05:46:03 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 HTTP/1.1 Apr 14 05:46:03 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:46:03 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:46:03 user devstack@n-api.service[61645]: Connection: close Apr 14 05:46:03 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:46:03 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:46:03 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:46:03 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:46:03 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOiNr_ClZICrYm8vewRCL77HkHoIjOI1pp8tQiAsCg5TENt31LcXdG-YWJc6m8e4gfk4m3f3FByxCkyJ-sTeghryW_yKMK9WGSboLMgWp5Mq9ush2WkLwAZldI5T1JcLolrd41oOoxJ-CicsKDgZ-NSt_A6587khex0nglcOiefG-Jg Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Project-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e5425f990244837961b88def982a0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Tenant-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-User: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61645]: X-User-Id: e906ef8c66cd48d6b2274c860e9b7601 Apr 14 05:46:03 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61645]: method: Apr 14 05:46:03 user devstack@n-api.service[61645]: exception: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61645]: action_args: {'id': '947da060-8356-4ad8-96d0-9d06304c73c4'} Apr 14 05:46:03 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. (HTTP 404) (Request-ID: req-eac6382d-dfd2-482e-8719-0e85832b17f5) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-45c45840-a362-4671-ab0e-aae650c4d650 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Returning 404 to user: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:46:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-45c45840-a362-4671-ab0e-aae650c4d650 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 404 len: 109 microversion: 2.1 time: 0.055059 Apr 14 05:46:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 05:46:03 2023] DELETE /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:46:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-54ff9f3a-7704-4d88-94e0-e65c65f46dd7 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Calling method '.version_select at 0x7f55e38877f0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-54ff9f3a-7704-4d88-94e0-e65c65f46dd7 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] HTTP exception thrown: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-54ff9f3a-7704-4d88-94e0-e65c65f46dd7 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Request method failure captured: Apr 14 05:46:03 user devstack@n-api.service[61644]: request: GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 HTTP/1.1 Apr 14 05:46:03 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:46:03 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:46:03 user devstack@n-api.service[61644]: Connection: close Apr 14 05:46:03 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:46:03 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:46:03 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:46:03 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:46:03 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOiNr_ClZICrYm8vewRCL77HkHoIjOI1pp8tQiAsCg5TENt31LcXdG-YWJc6m8e4gfk4m3f3FByxCkyJ-sTeghryW_yKMK9WGSboLMgWp5Mq9ush2WkLwAZldI5T1JcLolrd41oOoxJ-CicsKDgZ-NSt_A6587khex0nglcOiefG-Jg Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Project-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1e5425f990244837961b88def982a0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1e5425f990244837961b88def982a0c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Tenant-Id: 1e5425f990244837961b88def982a0c1 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1317203211 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-User: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:46:03 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:46:03 user devstack@n-api.service[61644]: X-User-Id: e906ef8c66cd48d6b2274c860e9b7601 Apr 14 05:46:03 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1317203211-project-member Apr 14 05:46:03 user devstack@n-api.service[61644]: method: Apr 14 05:46:03 user devstack@n-api.service[61644]: exception: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61644]: action_args: {'id': '947da060-8356-4ad8-96d0-9d06304c73c4'} Apr 14 05:46:03 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. (HTTP 404) (Request-ID: req-6480dce4-55f6-4261-8922-f887490e9ffe) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. Apr 14 05:46:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:46:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-54ff9f3a-7704-4d88-94e0-e65c65f46dd7 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] Returning 404 to user: Volume 947da060-8356-4ad8-96d0-9d06304c73c4 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:46:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-54ff9f3a-7704-4d88-94e0-e65c65f46dd7 tempest-VolumesSnapshotsTestJSON-1317203211 tempest-VolumesSnapshotsTestJSON-1317203211-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4" status: 404 len: 109 microversion: 2.1 time: 0.046622 Apr 14 05:46:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:46:03 2023] GET /compute/v2.1/os-volumes/947da060-8356-4ad8-96d0-9d06304c73c4 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:46:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-903134627", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "f17fe600-6a0b-44d9-a761-cfa2fd5b7515"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:11 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] validate_networks() for [('f17fe600-6a0b-44d9-a761-cfa2fd5b7515', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d7d141d6-2759-4c1e-8a5e-9ad325af228c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'create', calling method: .version_select at 0x7f55e43b13f0>, body: {"keypair": {"name": "tempest-keypair-1292881497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWgZSvStsIdBllMYITUwmuqQ//xCF9VZ+dweCxYVF5I1+XtbvXBqpCGg+3VG6koL7nHVoTJQeDf4gOGrVLkZrfLOdLZg4fZIrvOc8FP4FDDoxD5XtGdp4wyTnOCB5exw=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:12 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-d7d141d6-2759-4c1e-8a5e-9ad325af228c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting quotas for project 93092d7530694b63aba0a085051c0520. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:12 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-d7d141d6-2759-4c1e-8a5e-9ad325af228c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting quotas for user e733b69143e045bcbe99d823b02aab83 and project 93092d7530694b63aba0a085051c0520. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d7d141d6-2759-4c1e-8a5e-9ad325af228c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283355 Apr 14 05:46:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:46:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Getting quotas for project 115d9f93613748fe825f46c46e59c1d1. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Getting quotas for user c5ac7cb2e42e403b998381759f922e9f and project 115d9f93613748fe825f46c46e59c1d1. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:13 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7c7b69a2-830c-4f33-98aa-40e7a35364c7 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.301086 Apr 14 05:46:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 24/69] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-06cd2081-a317-40ef-97a8-c17fc5b06faa tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:13 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-06cd2081-a317-40ef-97a8-c17fc5b06faa tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:13 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-06cd2081-a317-40ef-97a8-c17fc5b06faa tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ac7cb2e42e403b998381759f922e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115d9f93613748fe825f46c46e59c1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-06cd2081-a317-40ef-97a8-c17fc5b06faa tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 200 len: 1208 microversion: 2.1 time: 0.150599 Apr 14 05:46:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:13 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 1208 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:16 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-586479502", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "94d980c4-edf3-4d22-8ae3-b029ad2d4516"}], "security_groups": [{"name": "tempest-securitygroup--1448502353"}], "key_name": "tempest-keypair-1292881497", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:17 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] validate_networks() for [('94d980c4-edf3-4d22-8ae3-b029ad2d4516', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting quotas for project 93092d7530694b63aba0a085051c0520. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Getting quotas for user e733b69143e045bcbe99d823b02aab83 and project 93092d7530694b63aba0a085051c0520. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-02f84919-7c2f-47f5-bd8c-d277062bcef0 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.975152 Apr 14 05:46:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 1980 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f1dbb3d5-ee04-4282-9a73-81cca58ad793 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f1dbb3d5-ee04-4282-9a73-81cca58ad793 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:19 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f1dbb3d5-ee04-4282-9a73-81cca58ad793 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f1dbb3d5-ee04-4282-9a73-81cca58ad793 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1239 microversion: 2.1 time: 0.344557 Apr 14 05:46:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 25/72] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:18 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1239 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Creating event network-changed:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61644) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-800d407e-8960-4b90-a080-e7442c0eb823 req-c102f73a-3639-48eb-94c1-a54fc56c6d47 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61644) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:21 user devstack@n-api.service[61644]: INFO nova.compute.rpcapi [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 05:46:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] Releasing lock "compute-rpcapi-router" {{(pid=61644) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 05:46:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9d64dd3e-87da-4e86-8dff-741c167ed063 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246265 Apr 14 05:46:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Creating event network-changed:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d2961958-16c0-43c9-8dab-7c25b36f2b3d req-20859698-b408-4b8e-95a7-f73f77f5c7ce service nova] Acquired lock "compute-rpcapi-router" {{(pid=61645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:24 user devstack@n-api.service[61645]: INFO nova.compute.rpcapi [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 05:46:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] Releasing lock "compute-rpcapi-router" {{(pid=61645) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 05:46:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9218d773-4cc1-41e6-9449-f7e91daf6609 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161555 Apr 14 05:46:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "name": "network-vif-plugged", "status": "completed", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Creating event network-vif-plugged:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61646) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e0ccd7a8-5b94-4408-8715-441c5cdf35b8 req-3d588fb7-9649-4cf0-a73a-f0b59a85ddfa service nova] Acquired lock "compute-rpcapi-router" {{(pid=61646) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:28 user devstack@n-api.service[61646]: INFO nova.compute.rpcapi [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 05:46:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] Releasing lock "compute-rpcapi-router" {{(pid=61646) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 05:46:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e4cfc066-403b-4b6c-98e4-be92e9ba6dc3 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123598 Apr 14 05:46:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:30 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "name": "network-vif-plugged", "status": "completed", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:31 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] Creating event network-vif-plugged:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:46:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-48ccbd77-33a7-4743-b540-1921800f4229 req-385d4bf0-cd41-45fb-8d39-ac9255285383 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187374 Apr 14 05:46:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:46:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e4b6b1be-cfad-42e5-bc71-99fd6f2a3ad6 req-cd6c126d-74cb-4cd1-9138-3bceb9ed4700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249161 Apr 14 05:46:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2f0a8714-1305-419e-b5b4-9074646c65db tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Action: 'create', calling method: .version_select at 0x7f55e37e00d0>, body: {"keypair": {"name": "tempest-keypair-1347509802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHubLnlaLGM24dmTAWf3L1Fc2fGI319C8qFPlbCxf8okKWTBrEwOsXZzfNL2S1nurfN2NJCKG/bNFXdy2Gc8G9HK7xV+4Myzrst68DbfnEuIFN/ifyU3RjdUwb5AlTrrBA=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:37 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-2f0a8714-1305-419e-b5b4-9074646c65db tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for project 0538df9180154c65a4405779a49914b3. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:37 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-2f0a8714-1305-419e-b5b4-9074646c65db tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for user 9c0ba3adada84bb0975af922caaaa2bc and project 0538df9180154c65a4405779a49914b3. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:46:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2f0a8714-1305-419e-b5b4-9074646c65db tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.368144 Apr 14 05:46:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:46:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-94391483-5c0f-4c41-9804-55cba29d0059 req-c5a601ea-54f2-4d18-90a2-1fabdcc37633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093072 Apr 14 05:46:37 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f8326240-5416-4185-ad46-2dddd6f40f14 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Action: 'create', calling method: .version_select at 0x7f55e377f910>, body: {"keypair": {"name": "tempest-keypair-158582486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnfcubVsQBfLOA1wjNKuWTurykGeBpeaZyMYeDJywSrmLIbojhKIcJpeOE5j7EqRz8GIyWueQsiHi4nb/13zZIIt/+0Eksp4Ay/EmllNww35CGJ6JYKt9DH9CPx35dd9A=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:38 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-f8326240-5416-4185-ad46-2dddd6f40f14 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting quotas for project 5f62071417bf445d8982419fb3cfb625. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:38 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-f8326240-5416-4185-ad46-2dddd6f40f14 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting quotas for user a1d16c8d82ea4d38b34bef8f1a9e9f92 and project 5f62071417bf445d8982419fb3cfb625. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f8326240-5416-4185-ad46-2dddd6f40f14 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.126110 Apr 14 05:46:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 27/80] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 05:46:38 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 05:46:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d7ff2377-9b5a-4fa0-b9a9-990b1841d9fd tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Action: 'create', calling method: .version_select at 0x7f55e37e0ca0>, body: {"keypair": {"name": "tempest-keypair-2132035066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlWU7SVFm1tuCRrJXBYhvYIFp1UGrJ9o4IhyFdcD6RPSdDHPG4GW2uaPqr39Fgtg+WJUvkXExcaodD0utoyGFmJWSNDe/TcAU9fLYSQ/bG1lEvcb1BNS+WLp+by8swzYg=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:38 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-d7ff2377-9b5a-4fa0-b9a9-990b1841d9fd tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting quotas for project 4dfd3e43c5734eb08d516280486d4beb. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:38 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-d7ff2377-9b5a-4fa0-b9a9-990b1841d9fd tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting quotas for user 81250be3e69f4c68b8f583fe5f4284ae and project 4dfd3e43c5734eb08d516280486d4beb. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d7ff2377-9b5a-4fa0-b9a9-990b1841d9fd tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102967 Apr 14 05:46:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 28/81] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:46:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-842887210", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "706e7dfb-b047-4c7c-921f-5e7cac4901df"}], "security_groups": [{"name": "tempest-securitygroup--1502157239"}], "key_name": "tempest-keypair-1347509802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:41 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] validate_networks() for [('706e7dfb-b047-4c7c-921f-5e7cac4901df', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:42 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1106076483", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "977dfb64-b72b-4f61-b628-2531e911dd6e"}]}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:42 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] validate_networks() for [('977dfb64-b72b-4f61-b628-2531e911dd6e', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8b05c81a-18f0-417f-9737-5c22a9efb053 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Action: 'create', calling method: .version_select at 0x7f55e37e2b00>, body: {"keypair": {"name": "tempest-keypair-242182190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7C9zWhHZvnaWFVobD0Mnfae2MSh5KaphNMZEvkfDqUhYz9gHy8VtkwzvotmLNtawW1HnxqUmpmcDAoolytTyapEaauUuRr5cFa5KaitiSsx6sUpMZWQHwqw1maXBxIbQ=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-8b05c81a-18f0-417f-9737-5c22a9efb053 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting quotas for project dec916486c6643bebea6707752266f8d. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-8b05c81a-18f0-417f-9737-5c22a9efb053 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting quotas for user 4b3721f81d2a41dc9493325afb204147 and project dec916486c6643bebea6707752266f8d. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8b05c81a-18f0-417f-9737-5c22a9efb053 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153990 Apr 14 05:46:42 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 29/82] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:46:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2066307036", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "11f5f265-3770-4817-9813-8039670d0f7f"}], "security_groups": [{"name": "tempest-securitygroup--1610723107"}], "key_name": "tempest-keypair-158582486", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for project 0538df9180154c65a4405779a49914b3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for user 9c0ba3adada84bb0975af922caaaa2bc and project 0538df9180154c65a4405779a49914b3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:42 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5b992c67-2042-4a3f-a3b7-3b8cfe1cba4b tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.420039 Apr 14 05:46:42 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 27/83] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:41 2023] POST /compute/v2.1/servers => generated 404 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fc67282b-2aa1-40d8-8336-2c69ed7143a9 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-fc67282b-2aa1-40d8-8336-2c69ed7143a9 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:42 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] validate_networks() for [('11f5f265-3770-4817-9813-8039670d0f7f', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:42 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-fc67282b-2aa1-40d8-8336-2c69ed7143a9 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:42 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-fc67282b-2aa1-40d8-8336-2c69ed7143a9 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403" status: 200 len: 1235 microversion: 2.1 time: 0.133677 Apr 14 05:46:42 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 28/84] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:42 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 => generated 1235 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:43 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1100985565", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "b7e63f6a-8aac-4de5-a83d-323daaf7d557"}], "security_groups": [{"name": "tempest-securitygroup--1048153785"}], "key_name": "tempest-keypair-2132035066", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:43 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] validate_networks() for [('b7e63f6a-8aac-4de5-a83d-323daaf7d557', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Getting quotas for project 6e9e42476ce14c31a05897a4a738ffd4. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:43 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Getting quotas for user 00dda4002041403eade471624793359c and project 6e9e42476ce14c31a05897a4a738ffd4. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-28cda659-eacf-4385-b234-dc0c24c82585 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.966260 Apr 14 05:46:43 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 1968 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1a7aa818-20fb-494e-9ee4-8d3d6892daf1 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-1a7aa818-20fb-494e-9ee4-8d3d6892daf1 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:43 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:43 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:43 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:43 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:43 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:43 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-1a7aa818-20fb-494e-9ee4-8d3d6892daf1 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dda4002041403eade471624793359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9e42476ce14c31a05897a4a738ffd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting quotas for project 5f62071417bf445d8982419fb3cfb625. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Getting quotas for user a1d16c8d82ea4d38b34bef8f1a9e9f92 and project 5f62071417bf445d8982419fb3cfb625. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-1a7aa818-20fb-494e-9ee4-8d3d6892daf1 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823" status: 200 len: 1208 microversion: 2.1 time: 0.234697 Apr 14 05:46:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 29/86] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:43 2023] GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 => generated 1208 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f8cc4a89-de71-46a3-9e59-95491ec24756 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.846634 Apr 14 05:46:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 30/87] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:46:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 1849 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=11 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting quotas for project 4dfd3e43c5734eb08d516280486d4beb. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Getting quotas for user 81250be3e69f4c68b8f583fe5f4284ae and project 4dfd3e43c5734eb08d516280486d4beb. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-be22ba2e-16e6-4fa6-b56d-b570e53f5720 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 200 len: 1320 microversion: 2.49 time: 0.099786 Apr 14 05:46:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 30/88] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:46:44 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 1320 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 05:46:44 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b3200b14-8f05-4d6e-87b8-4d6d73d6722e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.091857 Apr 14 05:46:44 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-bf3a4842-8db4-4065-80e7-0db14a91a7cc tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-bf3a4842-8db4-4065-80e7-0db14a91a7cc tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:44 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-bf3a4842-8db4-4065-80e7-0db14a91a7cc tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81250be3e69f4c68b8f583fe5f4284ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfd3e43c5734eb08d516280486d4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-bf3a4842-8db4-4065-80e7-0db14a91a7cc tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be" status: 200 len: 1226 microversion: 2.1 time: 0.093397 Apr 14 05:46:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 31/90] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:44 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-760918348", "imageRef": "265edea0-b46f-44ae-909b-198c71b4c8d1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a6fc7cf2-83ce-4137-8e63-a6316989706b"}], "security_groups": [{"name": "tempest-securitygroup--1575074250"}], "key_name": "tempest-keypair-242182190", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:44 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] validate_networks() for [('a6fc7cf2-83ce-4137-8e63-a6316989706b', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting quotas for project dec916486c6643bebea6707752266f8d. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Getting quotas for user 4b3721f81d2a41dc9493325afb204147 and project dec916486c6643bebea6707752266f8d. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:46:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='265edea0-b46f-44ae-909b-198c71b4c8d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:46:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-879a26e7-8813-42ef-abbf-64bc184e079b tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.978169 Apr 14 05:46:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 31/91] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:46:44 2023] POST /compute/v2.1/servers => generated 404 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:46:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a3c2a191-ddcc-411b-9945-7e7cf8a8f793 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:46:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a3c2a191-ddcc-411b-9945-7e7cf8a8f793 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:46:45 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-a3c2a191-ddcc-411b-9945-7e7cf8a8f793 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3721f81d2a41dc9493325afb204147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec916486c6643bebea6707752266f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:46:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a3c2a191-ddcc-411b-9945-7e7cf8a8f793 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 200 len: 1238 microversion: 2.1 time: 0.134341 Apr 14 05:46:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:46:45 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:46:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] Creating event network-changed:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:46:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-5fcac5d0-cb49-4415-95c7-123b26b6c85d req-f5e44594-fe19-4a95-8d72-949342a9d8b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043054 Apr 14 05:46:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:48 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] Creating event network-changed:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:46:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-54c52af5-58ad-4ccb-82d6-4dbb6684b704 req-cb56adc4-da60-4a6c-a402-4bec96312f20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062045 Apr 14 05:46:48 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:46:49 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] Creating event network-changed:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:46:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-61ed8e40-f78c-46a4-8ce4-0ab6bf2121a7 req-af4b7328-b6a3-4285-ab98-506473992695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037963 Apr 14 05:46:49 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] Creating event network-changed:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:46:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-e5106e48-37fe-4979-a576-e4f1acda0459 req-2199a897-eb34-4bc6-8e58-57f51d70289f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033442 Apr 14 05:46:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "name": "network-vif-plugged", "status": "completed", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] Creating event network-vif-plugged:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:46:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-048a1265-6cce-4992-ae30-32c24a255c39 req-9dae299c-9cb4-474f-b142-b05aa78a6dc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044035 Apr 14 05:46:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] Creating event network-changed:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:46:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-32f04503-58df-485f-be19-50cb49c66be6 req-1d4a373a-a91b-402a-bbb7-61039df13b56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043839 Apr 14 05:46:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=20 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "name": "network-vif-plugged", "status": "completed", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] Creating event network-vif-plugged:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:46:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a38ce70d-0767-4616-92ca-eb38424a35f8 req-e1309c86-bb21-4004-a944-6bd0cd7f97a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043241 Apr 14 05:46:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "name": "network-vif-plugged", "status": "completed", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] Creating event network-vif-plugged:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:46:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-3072774b-2871-40b9-8bdd-6df73e842cdd req-1b3991cb-3d26-4985-b4e0-4b2467635fb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049501 Apr 14 05:46:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=16 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "name": "network-vif-plugged", "status": "completed", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] Creating event network-vif-plugged:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:46:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-4d68befb-4edf-4e1c-b291-5923b3ac7426 req-a3b8e9f2-2ffb-45ae-becc-3b56cc26e8ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039787 Apr 14 05:46:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:57 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] Creating event network-vif-plugged:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:46:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-4a459c0d-8b4e-404a-87ba-92ca8ee7759d req-e66f7b5a-64a1-4ff8-84da-a2e4fad69f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042112 Apr 14 05:46:57 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=20 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "name": "network-vif-plugged", "status": "completed", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] Creating event network-vif-plugged:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:46:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-59b0f664-ca58-4220-8da4-f4b457f0e206 req-19ea2723-91f1-486b-b1d5-8e1f1b067225 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097123 Apr 14 05:46:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 35/103] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "name": "network-vif-plugged", "status": "completed", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}, {"server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "name": "network-vif-plugged", "status": "completed", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}, {"server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "name": "network-vif-plugged", "status": "completed", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Creating event network-vif-plugged:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:46:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Creating event network-vif-plugged:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:46:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] Creating event network-vif-plugged:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:46:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-44ed7792-5b90-4b52-9c6a-c87d5080f3cf req-0ff7c75b-9b5f-4dc3-aac3-f1248bd1518d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.074367 Apr 14 05:46:58 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:46:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:46:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:46:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:46:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:46:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] Creating event network-vif-plugged:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:46:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-fa42a066-e699-41ea-93e2-8c91499e75bc req-17cfd45b-1e65-4689-a0ab-7ccf11ebfc8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058369 Apr 14 05:46:59 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 36/105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:46:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:04 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ac7cb2e42e403b998381759f922e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115d9f93613748fe825f46c46e59c1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b48bb406-8da7-4a4a-bfbf-1f276ab17264 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 200 len: 1490 microversion: 2.1 time: 0.574394 Apr 14 05:47:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:03 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 1490 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-02277cb2-89f3-467e-9445-e33f0ee886d5 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Action: 'create', calling method: .version_select at 0x7f55e2e58700>, body: {"keypair": {"name": "tempest-keypair-980831644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBnFl8XqxpybcNU2Ugm6RZwxg6MZgDS7XpuCxdeKDMwJr00U/9en9UjTKdO4mAd5H3Ng4vwx7Tk7gALLqxHBuHnWC5j2bFXwhVoVhFume73N2Y/4u9HLf7+bv5WCY7u7g=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:04 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-02277cb2-89f3-467e-9445-e33f0ee886d5 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting quotas for project 4d2a45bad5274464a0b89b9e275e515e. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:47:04 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-02277cb2-89f3-467e-9445-e33f0ee886d5 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting quotas for user 837f8d05577c40488c01fb21472b8870 and project 4d2a45bad5274464a0b89b9e275e515e. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:47:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-02277cb2-89f3-467e-9445-e33f0ee886d5 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.170701 Apr 14 05:47:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 35/107] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 05:47:04 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 05:47:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-408811920", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b076dc22-7038-47cc-9fc1-285afb5578cf"}, {"port": "517e0448-275c-437e-9b1b-e81c27f404b4", "tag": "port-1"}, {"port": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231", "tag": "port-2"}, {"uuid": "9d6092be-0b36-4852-97f7-8fc43c108ba6", "tag": "net-1"}, {"uuid": "9d6092be-0b36-4852-97f7-8fc43c108ba6"}, {"uuid": "6b529ca6-1438-4bad-a5ca-92070f391324", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6b529ca6-1438-4bad-a5ca-92070f391324", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b4966c0d-81ad-4a8d-ba8c-8fac2291fa66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "90474409-44a2-4504-806d-b14d1201747a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c84bb1fa-5bc5-450e-a928-f875d1a0e0f8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--669263420"}], "key_name": "tempest-keypair-980831644", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:07 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] validate_networks() for [('b076dc22-7038-47cc-9fc1-285afb5578cf', None, None, None, None, None), (None, None, '517e0448-275c-437e-9b1b-e81c27f404b4', None, None, None), (None, None, '26e5a8e2-6c30-42f8-b5a5-1c3a48515231', None, None, None), ('9d6092be-0b36-4852-97f7-8fc43c108ba6', None, None, None, None, None), ('9d6092be-0b36-4852-97f7-8fc43c108ba6', None, None, None, None, None), ('6b529ca6-1438-4bad-a5ca-92070f391324', '10.2.2.100', None, None, None, None), ('6b529ca6-1438-4bad-a5ca-92070f391324', '10.2.2.200', None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:47:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=21 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-15497ccd-d8b9-497b-841c-e220e9461586 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1554 microversion: 2.1 time: 0.426656 Apr 14 05:47:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 37/108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:09 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1554 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting quotas for project 4d2a45bad5274464a0b89b9e275e515e. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Getting quotas for user 837f8d05577c40488c01fb21472b8870 and project 4d2a45bad5274464a0b89b9e275e515e. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:47:11 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=9 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:11 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b4966c0d-81ad-4a8d-ba8c-8fac2291fa66',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='90474409-44a2-4504-806d-b14d1201747a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c84bb1fa-5bc5-450e-a928-f875d1a0e0f8',volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:47:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-19eaac35-cf6b-4ea0-a0cc-651eaa683934 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Action: 'create', calling method: .version_select at 0x7f55e2e5a710>, body: {"keypair": {"name": "tempest-keypair-547240992", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGDnI2AI+dm3QfMqJI1B0oIz27QM9UdxK3qxcLj4vZvsl4xbn8BOrEXaSNaFS9MrCuSVhEAMNJ148ap8E5rLhhY/9Ym0zONxRVOxOZuwz4AF6pGVwqQDamATBVZDuUE+A=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:11 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-19eaac35-cf6b-4ea0-a0cc-651eaa683934 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting quotas for project 3ea91450b53a4089beb572b96e80a902. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:47:11 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-19eaac35-cf6b-4ea0-a0cc-651eaa683934 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting quotas for user 7c09793a3c314acc93ba7c04d67117d0 and project 3ea91450b53a4089beb572b96e80a902. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:47:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-19eaac35-cf6b-4ea0-a0cc-651eaa683934 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.088115 Apr 14 05:47:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 36/109] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 05:47:11 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 14 05:47:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0c2a4c5f-8fe1-429b-9df0-106d2f9858ba tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 4.777364 Apr 14 05:47:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 37/110] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 05:47:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 4784 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:47:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:12 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b5cda482-ba6e-439f-9231-25550473a3e1 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 200 len: 1278 microversion: 2.42 time: 0.134482 Apr 14 05:47:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 38/111] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:47:12 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:47:14 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-817313929", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b"}, {"port": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8", "tag": "port-1"}, {"port": "5864d2bf-030a-4e87-a76c-49ca62310068", "tag": "port-2"}, {"uuid": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3", "tag": "net-1"}, {"uuid": "3cdd9afa-ae91-4afe-9e17-a71ba88c19c3"}, {"uuid": "f3371995-f205-4d29-a6d1-daca8ec77945", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f3371995-f205-4d29-a6d1-daca8ec77945", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "878c8790-7e7d-4f18-8a8a-4e5d604ff7f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "2e76089a-274f-42de-b122-45493f24a8f8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f35b9638-fe96-4afc-a249-05ed5a32851d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1252682845"}], "key_name": "tempest-keypair-547240992", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:14 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=5 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:14 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] validate_networks() for [('d2adaf18-4c0f-45eb-b8b1-c9cd19671d1b', None, None, None, None, None), (None, None, 'dac3f3ff-eeab-49f2-a538-061dc6d4afc8', None, None, None), (None, None, '5864d2bf-030a-4e87-a76c-49ca62310068', None, None, None), ('3cdd9afa-ae91-4afe-9e17-a71ba88c19c3', None, None, None, None, None), ('3cdd9afa-ae91-4afe-9e17-a71ba88c19c3', None, None, None, None, None), ('f3371995-f205-4d29-a6d1-daca8ec77945', '10.2.2.100', None, None, None, None), ('f3371995-f205-4d29-a6d1-daca8ec77945', '10.2.2.200', None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting quotas for project 3ea91450b53a4089beb572b96e80a902. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:47:17 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Getting quotas for user 7c09793a3c314acc93ba7c04d67117d0 and project 3ea91450b53a4089beb572b96e80a902. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:47:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:47:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='878c8790-7e7d-4f18-8a8a-4e5d604ff7f1',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='2e76089a-274f-42de-b122-45493f24a8f8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f35b9638-fe96-4afc-a249-05ed5a32851d',volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:47:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-61f31b69-47f4-4592-83f0-f07cd2edbb2d tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.331323 Apr 14 05:47:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 37/112] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 05:47:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 4333 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:47:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:18 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:18 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:18 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b30b7847-eee0-4411-a5ea-b83c2d250556 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 200 len: 1278 microversion: 2.32 time: 0.079907 Apr 14 05:47:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 38/113] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:47:18 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 1278 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:47:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=5 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] Creating event network-changed:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e7fda0e5-5b78-4e5e-96aa-c6bfa2d116fd req-badebfb9-f294-430c-8eb5-18a53c546f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Apr 14 05:47:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "517e0448-275c-437e-9b1b-e81c27f404b4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] Creating event network-changed:517e0448-275c-437e-9b1b-e81c27f404b4 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-9f13a5b0-3f47-44e6-afd8-2e84722f71ee req-e8a02a28-e85b-46dd-86ea-e5364b67072e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Apr 14 05:47:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] Creating event network-changed:26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-cba3796f-16ba-4fbc-897f-17e79788572d req-f26a56e9-0b39-4ced-b8dd-a8cb3ba70968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041535 Apr 14 05:47:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:25 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] Creating event network-changed:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-8d6a54de-1095-4949-a79b-174234e43d84 req-40cfbc0b-6104-4be7-bf90-ace9c2403c3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033496 Apr 14 05:47:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}, {"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}, {"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Creating event network-changed:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Creating event network-changed:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] Creating event network-changed:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-cc501cad-9ef3-4309-87ce-190e11755a09 req-f9b1e777-adc5-4ef8-9a7f-d6d08ad12e07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.066385 Apr 14 05:47:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8"}, {"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "5864d2bf-030a-4e87-a76c-49ca62310068"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Creating event network-changed:dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] Creating event network-changed:5864d2bf-030a-4e87-a76c-49ca62310068 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-78343874-8837-409c-a8c6-1b83b9a944d5 req-a71dafe1-3448-403c-b656-6d149181019d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035560 Apr 14 05:47:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] Creating event network-changed:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-13827087-d41d-4c12-986e-d7b91f7dcd66 req-72565ee9-de42-40d4-9d3d-c897014f23ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035564 Apr 14 05:47:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=14 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}, {"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:30 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Creating event network-changed:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:30 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] Creating event network-changed:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:30 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e26f5c09-c3ef-44e8-b6e1-6d13fe848073 req-d5db1ea9-b6da-4045-8415-652fc6344d22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045785 Apr 14 05:47:30 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:30 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:32 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:32 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}, {"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:32 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Creating event network-changed:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:32 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] Creating event network-changed:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:32 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-3689fdca-0173-45ec-ad61-e54ff6148f30 req-5dc6a64b-116c-40ec-a380-3eaf7509a2cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038671 Apr 14 05:47:32 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:32 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:33 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e313c47a-1cf6-4cd3-b5c0-6a9f4555689a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403" status: 200 len: 1544 microversion: 2.1 time: 0.311961 Apr 14 05:47:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:32 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 => generated 1544 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:34 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dda4002041403eade471624793359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9e42476ce14c31a05897a4a738ffd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-39bf6e66-905e-4a25-9cbe-fe571c8643dc tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823" status: 200 len: 1485 microversion: 2.1 time: 0.533866 Apr 14 05:47:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:34 2023] GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 => generated 1485 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-80db3a9b-eb58-43ce-b6cf-da4157d5ae32 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 200 len: 1628 microversion: 2.49 time: 0.452588 Apr 14 05:47:34 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 42/125] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:47:34 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 1628 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:47:34 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81250be3e69f4c68b8f583fe5f4284ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfd3e43c5734eb08d516280486d4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:34 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-618b9c7f-5cc4-4235-999c-ffa77dec5e54 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be" status: 200 len: 1525 microversion: 2.1 time: 0.312399 Apr 14 05:47:34 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 43/126] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:34 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be => generated 1525 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:36 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3721f81d2a41dc9493325afb204147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec916486c6643bebea6707752266f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b48075e1-4b02-40ce-849b-af367d25e195 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 200 len: 1547 microversion: 2.1 time: 0.182792 Apr 14 05:47:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:35 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] Creating event network-vif-plugged:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-cb9911d2-3ddc-478e-9e54-b7a9fbc03303 req-856bf343-781b-4a5e-bf34-704aa181b933 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057416 Apr 14 05:47:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=18 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] Creating event network-vif-plugged:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-143d19c7-333f-42db-a8e8-20c32d860570 req-6d45e085-a1c3-450f-980f-73687efb2d2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050356 Apr 14 05:47:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "517e0448-275c-437e-9b1b-e81c27f404b4"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "517e0448-275c-437e-9b1b-e81c27f404b4"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=20 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Creating event network-vif-plugged:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Creating event network-vif-plugged:517e0448-275c-437e-9b1b-e81c27f404b4 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Creating event network-vif-plugged:517e0448-275c-437e-9b1b-e81c27f404b4 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Creating event network-vif-plugged:26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] Creating event network-vif-plugged:26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-009b13f2-6465-4a0f-97d6-c1760bfd3a0c req-5154db63-fa40-40af-967f-38ba4193fe56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.051727 Apr 14 05:47:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:48 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Creating event network-vif-plugged:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Creating event network-vif-plugged:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Creating event network-vif-plugged:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Creating event network-vif-plugged:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] Creating event network-vif-plugged:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-0c63c027-ccae-465f-8080-02a4c9677ad4 req-8e957aa7-04ea-4f7e-ac56-71a30e99f256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.045851 Apr 14 05:47:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:49 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:47:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Creating event network-vif-plugged:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Creating event network-vif-plugged:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:47:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] Creating event network-vif-plugged:dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-867e0362-cb29-436b-8bc6-16c4035bdb9e req-04b0756d-9cc3-48e8-afc5-a1f9ef653e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.085831 Apr 14 05:47:50 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:51 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] Creating event network-vif-plugged:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-71a1baa5-b95c-4e75-b549-0808cd2f86a0 req-cff06651-bbc0-4ad1-9a5c-7d921786a234 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095089 Apr 14 05:47:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "5864d2bf-030a-4e87-a76c-49ca62310068"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "5864d2bf-030a-4e87-a76c-49ca62310068"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Creating event network-vif-plugged:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Creating event network-vif-plugged:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Creating event network-vif-plugged:5864d2bf-030a-4e87-a76c-49ca62310068 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Creating event network-vif-plugged:5864d2bf-030a-4e87-a76c-49ca62310068 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] Creating event network-vif-plugged:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-210d6534-9973-4bb4-b830-a1462c7f1746 req-74816039-a6f6-4f61-ba05-b567e6347901 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.046934 Apr 14 05:47:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:51 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Creating event network-vif-plugged:dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Creating event network-vif-plugged:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] Creating event network-vif-plugged:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-f2da1b34-428e-4d88-a387-0cec660556b3 req-5266da85-eb0c-4bc7-91f2-241a3eadbe3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044779 Apr 14 05:47:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:52 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Creating event network-vif-plugged:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Creating event network-vif-plugged:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] Creating event network-vif-plugged:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-89fe913b-e386-47ce-bf93-8ab3379f11fe req-01102647-d142-4ec4-afa6-300f57f17b63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051473 Apr 14 05:47:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1009909021", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "0cf97719-b5e5-4a6e-8f63-5d1e3c365e7e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] Creating event network-vif-plugged:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:47:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-82cead01-9fba-48b0-8b97-c5985ac125ba req-2efc8d90-8ede-4ed1-af34-a123ed9d8708 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046601 Apr 14 05:47:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:47:53 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:47:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='0cf97719-b5e5-4a6e-8f63-5d1e3c365e7e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:47:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-815ce658-1503-496e-9e77-41b10bbbfcc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.752421 Apr 14 05:47:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 46/138] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:47:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:47:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-30b971c3-7ac0-44a2-a219-bfb5256a6368 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:47:54 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-30b971c3-7ac0-44a2-a219-bfb5256a6368 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:47:54 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-30b971c3-7ac0-44a2-a219-bfb5256a6368 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:47:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-30b971c3-7ac0-44a2-a219-bfb5256a6368 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 200 len: 1052 microversion: 2.1 time: 0.076066 Apr 14 05:47:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:47:54 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 1052 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:47:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:47:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:47:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:47:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:47:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] Creating event network-changed:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:47:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-85605fd6-664d-41af-a4f9-1fe03bbbe56c req-cf15f67a-be43-4488-8856-7eb51b57a72e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046559 Apr 14 05:47:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:47:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:02 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f228397a-7b75-4ca8-b364-21f44fa37a94 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 200 len: 2823 microversion: 2.42 time: 0.245830 Apr 14 05:48:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 47/141] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:48:02 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 2823 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "499d646d-6940-4a45-a551-4df4745e44f3"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-44a986bc-1066-4f2e-8bce-fd74f029e46d tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.605090 Apr 14 05:48:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 47/142] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:48:06 2023] POST /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59/os-volume_attachments => generated 194 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:08 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f19bea46-a50d-4d6c-8c69-f509d486e679 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 200 len: 2822 microversion: 2.32 time: 0.365407 Apr 14 05:48:08 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 49/143] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:48:08 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 2822 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ea6ae784-5acf-4d3d-932f-5cd5aa04d2ce tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.447383 Apr 14 05:48:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:48:09 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-interface => generated 283 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "name": "network-vif-plugged", "status": "completed", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] Creating event network-vif-plugged:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:48:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-05601e3e-6528-414d-a8a9-851799c274b2 req-1655c129-e130-4516-a52c-9af1c4287980 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Apr 14 05:48:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-296438309"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a6fdb065-eb72-47b5-8d15-2e1de1155ef4 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action" status: 202 len: 0 microversion: 2.1 time: 1.117151 Apr 14 05:48:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 50/146] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:48:12 2023] POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 05:48:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ca0ca819-6725-4d25-b730-f53818d2a81c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '.version_select at 0x7f55e2e56d40>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ca0ca819-6725-4d25-b730-f53818d2a81c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2" status: 200 len: 1610 microversion: 2.1 time: 0.047297 Apr 14 05:48:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 05:48:13 2023] GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2 => generated 1610 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:48:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}, {"server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "name": "network-vif-plugged", "status": "completed", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:14 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Creating event network-changed:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:48:14 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] Creating event network-vif-plugged:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:48:14 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b20d84df-20fb-49fd-bd6d-25a150438754 req-c48bc90c-fcca-440d-8c2f-651b666b2ada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036007 Apr 14 05:48:14 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 49/148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:48:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9c4cce38-306f-47ff-a4db-c7a8b2834cd2 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 204 len: 0 microversion: 2.1 time: 0.202877 Apr 14 05:48:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:48:17 2023] DELETE /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=19 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:17 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5ac7cb2e42e403b998381759f922e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '115d9f93613748fe825f46c46e59c1d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-108e77a9-8ae8-4b30-ad93-98da1074f278 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 200 len: 1542 microversion: 2.1 time: 0.257990 Apr 14 05:48:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:48:17 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:48:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "name": "network-vif-unplugged", "status": "completed", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] Creating event network-vif-unplugged:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:48:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7394b29e-ae97-4cc2-b61e-413c923cf843 req-0f8f49e3-045b-4477-9dbd-1b654dc591e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033072 Apr 14 05:48:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "name": "network-vif-plugged", "status": "completed", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}, {"server_uuid": "91642571-ef07-4990-bdf8-068203203d59", "name": "network-vif-deleted", "tag": "7cb9f34b-1d26-4234-acfd-9c6252d4dcbd"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Creating event network-vif-plugged:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:48:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] Creating event network-vif-deleted:7cb9f34b-1d26-4234-acfd-9c6252d4dcbd for instance 91642571-ef07-4990-bdf8-068203203d59 on user Apr 14 05:48:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c6d420f0-1faf-4669-828c-b1eed9b904ac req-015988c6-7cb1-4453-b96f-f1c9362c23ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034025 Apr 14 05:48:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 52/152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=5 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e8d9bf20-4798-4311-aafa-65f1f42782b1 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.125897 Apr 14 05:48:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:48:33 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] Creating event network-changed:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:48:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-2b54202c-f111-4227-9b99-a7399f6add18 req-80756f22-d971-462b-9db0-3ad0a9d9418f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049435 Apr 14 05:48:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:34 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-76a6e251-9c44-4d1a-a08a-0bb000e6fa49 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.145496 Apr 14 05:48:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 52/155] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:48:34 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-interface => generated 282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-eb76b7ac-79dd-400b-ba3c-91d7a0cb55ee tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.174281 Apr 14 05:48:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 53/156] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:48:34 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface => generated 283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5a320152-74f7-4a80-93a6-a96ed2434cfe tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.103621 Apr 14 05:48:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:48:36 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:36 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] Creating event network-changed:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:36 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-c453e1c2-8dd3-4819-ae59-e39c4d8ed8ac req-7fec243b-c02d-4412-b2f4-36b2e5c65a5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028856 Apr 14 05:48:36 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 53/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d5e24bd-9225-4eb3-8359-d4c380c66e0d"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3957b012-1f0e-4cd0-a09a-4a4a45e9d535 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 200 len: 1628 microversion: 2.49 time: 0.231410 Apr 14 05:48:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 54/159] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:48:36 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 1628 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "b9689044-f32a-429b-94fa-ad9b10cf6c04", "tag": "nic-tag"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-edeaf98d-c318-4f9e-8ecf-85a992781922 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347851 Apr 14 05:48:37 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:48:36 2023] POST /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "daca84b5-035a-4aaa-98b5-a7b193293fac"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7408dddb-f44c-41bf-a499-719cd31ba27f tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "POST /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353943 Apr 14 05:48:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 55/161] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:48:37 2023] POST /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] Creating event network-changed:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:48:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7aeb0039-20df-4745-aeaa-38978d86323c req-90120519-b8ad-45df-973f-2c0b71eba5e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050956 Apr 14 05:48:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] Creating event network-changed:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:48:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-afa695ad-b72e-4ce8-ab4d-f444999c8911 req-cefb72f1-72c3-4fb6-924c-79699036f33e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052825 Apr 14 05:48:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 56/163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "231936ce-a3ba-4ab6-8461-ea35634886f0"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4c22e1fa-c69a-4e8d-93b7-5fd0c6beb27a tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467739 Apr 14 05:48:40 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 55/164] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:48:39 2023] POST /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-53938dae-1f16-4a68-960d-bba1440509e0 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.488529 Apr 14 05:48:40 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 54/165] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 05:48:37 2023] POST /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface => generated 282 bytes in 3490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b228e9f-b052-4cab-9482-b8e50b290a9a", "tag": "volume-tag"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}, {"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}, {"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:40 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Creating event network-changed:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Creating event network-vif-plugged:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] Creating event network-vif-plugged:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-97966591-627b-4d73-9a70-6e23ff96ffc7 req-aa6820d3-8b17-4d5f-a2b8-cea1d64d11e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.056227 Apr 14 05:48:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:40 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:42 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:48:42 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-bd9fb4a9-d56c-4e1e-9cad-488ea555d0ff tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 2.144429 Apr 14 05:48:42 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 57/167] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 05:48:40 2023] POST /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments => generated 194 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:48:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a42d5ecc-77e3-46f4-95bd-a2823f44da81 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823" status: 204 len: 0 microversion: 2.1 time: 0.207925 Apr 14 05:48:42 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 55/168] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:48:42 2023] DELETE /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:43 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00dda4002041403eade471624793359c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9e42476ce14c31a05897a4a738ffd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:43 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1de6c867-24b7-43b1-b683-c0de19389e8b tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823" status: 200 len: 1491 microversion: 2.1 time: 0.243736 Apr 14 05:48:43 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:48:42 2023] GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 => generated 1491 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:48:43 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "name": "network-vif-unplugged", "status": "completed", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] Creating event network-vif-unplugged:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:48:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-3451adb7-a24d-4d25-a5e3-6f23c4b36fbf req-6c3b43c2-c72d-414c-8989-bc49ac1e40d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065490 Apr 14 05:48:43 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "name": "network-vif-deleted", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] Creating event network-vif-deleted:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:48:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-5c017d9a-fc83-43b9-99a5-3a8b773ad90b req-bb7de433-b5b0-4107-89ad-c3673d9cd9c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045324 Apr 14 05:48:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 56/171] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:44 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:44 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1463f0c2-5753-4bf4-aed6-95f4ff0bf0f5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 200 len: 1379 microversion: 2.1 time: 0.215855 Apr 14 05:48:44 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:48:44 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 1379 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8c38aa08-6830-4cc2-a66f-76daa76f9c10"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc51328-8af2-4ddf-88e1-40cbba7a2823", "name": "network-vif-plugged", "status": "completed", "tag": "8452cfda-611d-4d2b-9976-e4fe1f7eb92d"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] Creating event network-vif-plugged:8452cfda-611d-4d2b-9976-e4fe1f7eb92d for instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 on user Apr 14 05:48:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-8a0379ba-a5e6-48d1-94ad-c3480048e0da req-ade45d78-e64f-45ff-a701-f080fb9ef345 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035049 Apr 14 05:48:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-baad8e30-55f3-4ff2-9106-39c5f191f573 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/5d5e24bd-9225-4eb3-8359-d4c380c66e0d" status: 202 len: 0 microversion: 2.1 time: 0.556202 Apr 14 05:48:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 59/174] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 05:48:44 2023] PUT /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/5d5e24bd-9225-4eb3-8359-d4c380c66e0d => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "96fce9cc-7027-4f7c-a292-3b5ac2bed78f"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] HTTP exception thrown: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Request method failure captured: Apr 14 05:48:47 user devstack@n-api.service[61644]: request: PUT /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments/daca84b5-035a-4aaa-98b5-a7b193293fac HTTP/1.1 Apr 14 05:48:47 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:48:47 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:48:47 user devstack@n-api.service[61644]: Connection: close Apr 14 05:48:47 user devstack@n-api.service[61644]: Content-Length: 74 Apr 14 05:48:47 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:48:47 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:48:47 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:48:47 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOi9YymkPdMRyzHgq6162i67ORymfQ6KozY0uAo1x4dgPJ8aapd1dffebv_OnrkpsPveWjD5uhvXSzFDP7lNpmH5dnef2VRlSAD8h31K1-4742QFpyRIoVHcveGjhWL9rt3Tbmf_8y-9BYXZEFcHtxwHP11-feKojFEOusBcmT948mI Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Project-Id: 2a2288466c1349dd98e48e4e4b98a2f5 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Role: admin,member,reader Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Roles: admin,member,reader Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Tenant-Id: 2a2288466c1349dd98e48e4e4b98a2f5 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:48:47 user devstack@n-api.service[61644]: X-User: tempest-VolumesAdminNegativeTest-1549365854-project-admin Apr 14 05:48:47 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:48:47 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:48:47 user devstack@n-api.service[61644]: X-User-Id: 202a385d001a42179ab59fdf29dca70d Apr 14 05:48:47 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesAdminNegativeTest-1549365854-project-admin Apr 14 05:48:47 user devstack@n-api.service[61644]: Apr 14 05:48:47 user devstack@n-api.service[61644]: {"volumeAttachment": {"volumeId": "96fce9cc-7027-4f7c-a292-3b5ac2bed78f"}} Apr 14 05:48:47 user devstack@n-api.service[61644]: method: > Apr 14 05:48:47 user devstack@n-api.service[61644]: exception: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. Apr 14 05:48:47 user devstack@n-api.service[61644]: action_args: {'server_id': '932e9aba-ecce-4d2e-8486-eb2e3c685403', 'id': 'daca84b5-035a-4aaa-98b5-a7b193293fac', 'body': {'volumeAttachment': {'volumeId': '96fce9cc-7027-4f7c-a292-3b5ac2bed78f'}}} Apr 14 05:48:47 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. (HTTP 404) (Request-ID: req-445a126b-077f-4abc-8065-8dc2b218e606) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. Apr 14 05:48:47 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:48:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Returning 400 to user: Volume 96fce9cc-7027-4f7c-a292-3b5ac2bed78f could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:48:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-bec9452e-3106-411a-81bf-685255287f00 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments/daca84b5-035a-4aaa-98b5-a7b193293fac" status: 400 len: 107 microversion: 2.1 time: 0.302129 Apr 14 05:48:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 05:48:46 2023] PUT /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments/daca84b5-035a-4aaa-98b5-a7b193293fac => generated 107 bytes in 304 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lazy-loading 'services' on Instance uuid 932e9aba-ecce-4d2e-8486-eb2e3c685403 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:48:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8ae031a8-b553-4283-84e5-47dc684f5221 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments/daca84b5-035a-4aaa-98b5-a7b193293fac" status: 202 len: 0 microversion: 2.1 time: 0.285839 Apr 14 05:48:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:48:47 2023] DELETE /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments/daca84b5-035a-4aaa-98b5-a7b193293fac => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c66c1925-7111-4bc7-8250-e8789cbd444e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054554 Apr 14 05:48:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:47 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-36e89b22-c249-4939-8d16-131ab097d792 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058707 Apr 14 05:48:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:48 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:48 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lazy-loading 'services' on Instance uuid 4f0881a2-86a2-40e5-8c3a-1ca12da65aae {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:48:48 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-acb92ea0-75ce-45aa-b917-aefe503a25fd tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments/231936ce-a3ba-4ab6-8461-ea35634886f0" status: 202 len: 0 microversion: 2.1 time: 0.169254 Apr 14 05:48:48 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:48:48 2023] DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments/231936ce-a3ba-4ab6-8461-ea35634886f0 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lazy-loading 'services' on Instance uuid b91c97cd-ba56-4cd7-845d-28e6c9f37836 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:48:51 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a0f3bb65-7954-4c1e-9c3a-e91bd42d5c47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments/2b228e9f-b052-4cab-9482-b8e50b290a9a" status: 202 len: 0 microversion: 2.49 time: 0.303147 Apr 14 05:48:51 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 61/180] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 05:48:50 2023] DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments/2b228e9f-b052-4cab-9482-b8e50b290a9a => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a59c6be6-8916-4ebe-ab8d-82a7dc5d7cc9 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047079 Apr 14 05:48:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 61/181] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:51 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-029103fe-ae1d-4fe2-aaf1-080c79dbd8f6 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046268 Apr 14 05:48:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 60/182] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:51 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:52 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:48:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-83f75233-fe3e-47a0-b389-e8b2a2dc4f39 tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 204 len: 0 microversion: 2.1 time: 0.123147 Apr 14 05:48:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:48:51 2023] DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:52 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3721f81d2a41dc9493325afb204147', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec916486c6643bebea6707752266f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:48:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-513a60b4-7e38-4ef3-b916-cb039e8188ad tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 200 len: 1672 microversion: 2.1 time: 0.207326 Apr 14 05:48:52 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 62/184] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:48:52 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 1672 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:48:52 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "name": "network-vif-unplugged", "status": "completed", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] Creating event network-vif-unplugged:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:48:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1905f98e-2113-47a7-ad02-d1c54be0623d req-327364b8-1b1f-41e1-a64b-6ec93bfec0aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046515 Apr 14 05:48:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface/c32e89f7-517b-48a5-a592-61d3685581b0" status: 202 len: 0 microversion: 2.49 time: 0.065825 Apr 14 05:48:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 63/186] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 05:48:53 2023] DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-interface/c32e89f7-517b-48a5-a592-61d3685581b0 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e6e17b4a-e263-479f-87ab-503801f830ec tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834" status: 200 len: 474 microversion: 2.49 time: 0.218658 Apr 14 05:48:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 63/187] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 05:48:53 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 => generated 474 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:48:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "name": "network-vif-plugged", "status": "completed", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}, {"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-unplugged", "status": "completed", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Creating event network-vif-plugged:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:48:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] Creating event network-vif-unplugged:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-28facda9-3a97-4c84-b769-8ca96ffebf61 req-ef64f2c9-d1ed-4429-b97f-78154dde18bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.061551 Apr 14 05:48:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-deleted", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] Creating event network-vif-deleted:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-3e3daab7-5468-4f01-99b6-6d127afb88bc req-07b921dc-62c6-4a9d-ba47-769acb13a86a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046669 Apr 14 05:48:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:48:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "c32e89f7-517b-48a5-a592-61d3685581b0"}, {"server_uuid": "4f0881a2-86a2-40e5-8c3a-1ca12da65aae", "name": "network-vif-deleted", "tag": "5f81b5ce-2c7e-4901-953e-a39739dd26db"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Creating event network-vif-plugged:c32e89f7-517b-48a5-a592-61d3685581b0 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:48:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] Creating event network-vif-deleted:5f81b5ce-2c7e-4901-953e-a39739dd26db for instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae on user Apr 14 05:48:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b0ce494a-f28f-4892-8324-a0f3d030638a req-a01d3df3-2f08-44b8-9ec9-1cb673e7e7cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035399 Apr 14 05:48:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-37a65949-53fb-49f3-b2ea-8dcccaab1b1a tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051614 Apr 14 05:48:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 63/191] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:58 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=6,nova_cell1:INSERT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:48:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-366b86dc-b12d-43d6-84cc-2629cbbf0741 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Apr 14 05:48:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:48:58 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5d5e24bd-9225-4eb3-8359-d4c380c66e0d"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:48:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:48:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e1ec3ef8-b3d8-4995-b3d6-d00205499343 tempest-TestVolumeSwap-705958786 tempest-TestVolumeSwap-705958786-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/8c38aa08-6830-4cc2-a66f-76daa76f9c10" status: 202 len: 0 microversion: 2.1 time: 0.277139 Apr 14 05:48:58 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 05:48:58 2023] PUT /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/8c38aa08-6830-4cc2-a66f-76daa76f9c10 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2b80c589-98c8-40f8-a46d-4e7ce660243c tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.150162 Apr 14 05:49:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 64/194] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:49:02 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6/os-interface => generated 1828 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a0a9ab8f-b3c9-43cf-b6e3-75ddb46a2af2 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '.version_select at 0x7f55e2de7be0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a0a9ab8f-b3c9-43cf-b6e3-75ddb46a2af2 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2" status: 200 len: 1724 microversion: 2.1 time: 0.062005 Apr 14 05:49:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 05:49:03 2023] GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2 => generated 1724 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-700d75be-fb44-43ad-b721-10d5a393a50b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '.version_select at 0x7f55e2d9e170>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-700d75be-fb44-43ad-b721-10d5a393a50b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2" status: 200 len: 1724 microversion: 2.1 time: 0.056331 Apr 14 05:49:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 05:49:03 2023] GET /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2 => generated 1724 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] Creating event network-changed:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-487aca65-fbaa-4da4-a008-566e3d6f8cf8 req-1cd166f4-22d7-470a-8120-ff173b79933f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035755 Apr 14 05:49:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:03 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-6135baa7-9287-464e-a7fb-1529f0051a22 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1672 microversion: 2.1 time: 0.263825 Apr 14 05:49:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 65/198] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:03 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1672 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-2e372591-29b1-44ff-86e6-3f279ce0494d tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 200 len: 2823 microversion: 2.42 time: 0.381890 Apr 14 05:49:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 67/199] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:03 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 2823 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e5b2c96f-5994-40ce-b30f-0d0c64227658 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.217044 Apr 14 05:49:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 68/200] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:49:04 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6/os-interface => generated 1828 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:05 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:49:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7ec3b3d1-4ad7-47cd-95a0-8dfabcbab03b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 204 len: 0 microversion: 2.42 time: 0.174047 Apr 14 05:49:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 66/201] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:49:05 2023] DELETE /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=33 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:05 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:06 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:06 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:06 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '837f8d05577c40488c01fb21472b8870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2a45bad5274464a0b89b9e275e515e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1b951260-d5fd-4754-8ccb-233e93464d61 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 200 len: 2948 microversion: 2.42 time: 0.606352 Apr 14 05:49:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 68/202] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:05 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 2948 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:06 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] Creating event network-vif-unplugged:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-30db9c16-d4f7-4c39-9dd5-b47f4fa82954 req-42947848-bdb7-4610-b709-6b54c1e98b04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091004 Apr 14 05:49:06 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 69/203] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] Creating event network-vif-unplugged:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-58f2eafd-40f0-4899-a720-887a4381370d req-ff1f2e82-0c03-4192-a044-87f00849af51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048691 Apr 14 05:49:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 67/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] HTTP exception thrown: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Request method failure captured: Apr 14 05:49:07 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 HTTP/1.1 Apr 14 05:49:07 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:49:07 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:49:07 user devstack@n-api.service[61644]: Connection: close Apr 14 05:49:07 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:49:07 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:49:07 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:49:07 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:49:07 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOiih-9eU1bSQGMw10vjwBCCIpcaRR5_Gzfi1l1xOC_1sG3sAt9IU1PrrVkDn3y-1AYSGjg61fFGU2qVYSjZ77Z3_eUBuQhBY6R7wBFgz0HPSyX69MpvYF9hj0Hm9I2UXzTm6sZ_zD3YfupjMgVvGl6wiskWoKe4JNVVdF9uD6YhTI8 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Project-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Project-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Tenant: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Tenant-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61644]: X-User: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:07 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:49:07 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:49:07 user devstack@n-api.service[61644]: X-User-Id: c5ac7cb2e42e403b998381759f922e9f Apr 14 05:49:07 user devstack@n-api.service[61644]: X-User-Name: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:07 user devstack@n-api.service[61644]: method: > Apr 14 05:49:07 user devstack@n-api.service[61644]: exception: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61644]: action_args: {'id': '91642571-ef07-4990-bdf8-068203203d59'} Apr 14 05:49:07 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Returning 404 to user: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1949cb40-2b5c-4b57-b656-bb62fefee9d1 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 404 len: 111 microversion: 2.1 time: 0.042425 Apr 14 05:49:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:07 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] HTTP exception thrown: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Request method failure captured: Apr 14 05:49:07 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59/os-volume_attachments HTTP/1.1 Apr 14 05:49:07 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:49:07 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:49:07 user devstack@n-api.service[61645]: Connection: close Apr 14 05:49:07 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:49:07 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:49:07 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:49:07 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:49:07 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOiih-9eU1bSQGMw10vjwBCCIpcaRR5_Gzfi1l1xOC_1sG3sAt9IU1PrrVkDn3y-1AYSGjg61fFGU2qVYSjZ77Z3_eUBuQhBY6R7wBFgz0HPSyX69MpvYF9hj0Hm9I2UXzTm6sZ_zD3YfupjMgVvGl6wiskWoKe4JNVVdF9uD6YhTI8 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Project-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Project-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Tenant: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Tenant-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:07 user devstack@n-api.service[61645]: X-User: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:07 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:49:07 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:49:07 user devstack@n-api.service[61645]: X-User-Id: c5ac7cb2e42e403b998381759f922e9f Apr 14 05:49:07 user devstack@n-api.service[61645]: X-User-Name: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:07 user devstack@n-api.service[61645]: method: > Apr 14 05:49:07 user devstack@n-api.service[61645]: exception: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61645]: action_args: {'server_id': '91642571-ef07-4990-bdf8-068203203d59'} Apr 14 05:49:07 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:07 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Returning 404 to user: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e409d84f-5cf0-434f-9171-9f43e8b2f2fb tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057852 Apr 14 05:49:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 70/206] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:49:07 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "517e0448-275c-437e-9b1b-e81c27f404b4"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "517e0448-275c-437e-9b1b-e81c27f404b4"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Creating event network-vif-plugged:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Creating event network-vif-unplugged:517e0448-275c-437e-9b1b-e81c27f404b4 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Creating event network-vif-plugged:517e0448-275c-437e-9b1b-e81c27f404b4 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] Creating event network-vif-unplugged:26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-dc0f8aad-6a48-462d-8845-a9292b724779 req-e07f3c00-1bb8-49de-a37b-b06e96939cd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.060109 Apr 14 05:49:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 68/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Creating event network-vif-plugged:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Creating event network-vif-unplugged:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Creating event network-vif-plugged:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Creating event network-vif-unplugged:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] Creating event network-vif-plugged:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-02b7d8a1-095d-4f4a-b67a-1a36885de5be req-6c3f602d-0cb8-42f3-b386-fd526d4d67b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.040769 Apr 14 05:49:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:08 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c25cfb26-c78b-4da2-b8fa-f035cf6cb985 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.174915 Apr 14 05:49:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 71/209] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:49:08 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c/os-interface => generated 1829 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] Creating event network-changed:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-5e47fdce-d0e8-478b-90ed-81a7ffa0933c req-2fc28b9e-5b54-4bca-aad4-028b6342d919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039750 Apr 14 05:49:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 69/210] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "26e5a8e2-6c30-42f8-b5a5-1c3a48515231"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-unplugged", "status": "completed", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-plugged", "status": "completed", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Creating event network-vif-plugged:26e5a8e2-6c30-42f8-b5a5-1c3a48515231 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Creating event network-vif-unplugged:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] Creating event network-vif-plugged:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-ec19213e-84b3-429b-9e6d-a61917f8fcff req-5caef237-1b6d-4cea-a36f-79e344bed9ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.042241 Apr 14 05:49:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 72/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:10 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:10 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e706bf9f-d70a-4734-bc6a-afa410a042c7 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 200 len: 2822 microversion: 2.32 time: 0.382160 Apr 14 05:49:10 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:10 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 2822 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9a8655cc-bf87-4fb9-97c2-aef4581f40b2 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.174528 Apr 14 05:49:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 70/213] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:49:10 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c/os-interface => generated 1829 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] HTTP exception thrown: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Request method failure captured: Apr 14 05:49:11 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 HTTP/1.1 Apr 14 05:49:11 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:49:11 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:49:11 user devstack@n-api.service[61645]: Connection: close Apr 14 05:49:11 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:49:11 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:49:11 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:49:11 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:49:11 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOiih-9eU1bSQGMw10vjwBCCIpcaRR5_Gzfi1l1xOC_1sG3sAt9IU1PrrVkDn3y-1AYSGjg61fFGU2qVYSjZ77Z3_eUBuQhBY6R7wBFgz0HPSyX69MpvYF9hj0Hm9I2UXzTm6sZ_zD3YfupjMgVvGl6wiskWoKe4JNVVdF9uD6YhTI8 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Project-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Project-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Tenant: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Tenant-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61645]: X-User: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:11 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:49:11 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:49:11 user devstack@n-api.service[61645]: X-User-Id: c5ac7cb2e42e403b998381759f922e9f Apr 14 05:49:11 user devstack@n-api.service[61645]: X-User-Name: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:11 user devstack@n-api.service[61645]: method: > Apr 14 05:49:11 user devstack@n-api.service[61645]: exception: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61645]: action_args: {'id': '91642571-ef07-4990-bdf8-068203203d59'} Apr 14 05:49:11 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Returning 404 to user: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f3f9c224-d985-4981-acdf-8fcbfe5cfd41 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 404 len: 111 microversion: 2.1 time: 0.035557 Apr 14 05:49:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:49:11 2023] DELETE /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] [instance: 91642571-ef07-4990-bdf8-068203203d59] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] HTTP exception thrown: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Request method failure captured: Apr 14 05:49:11 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 HTTP/1.1 Apr 14 05:49:11 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:49:11 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:49:11 user devstack@n-api.service[61644]: Connection: close Apr 14 05:49:11 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:49:11 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:49:11 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:49:11 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:49:11 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOiih-9eU1bSQGMw10vjwBCCIpcaRR5_Gzfi1l1xOC_1sG3sAt9IU1PrrVkDn3y-1AYSGjg61fFGU2qVYSjZ77Z3_eUBuQhBY6R7wBFgz0HPSyX69MpvYF9hj0Hm9I2UXzTm6sZ_zD3YfupjMgVvGl6wiskWoKe4JNVVdF9uD6YhTI8 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Project-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Project-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/115d9f93613748fe825f46c46e59c1d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Tenant: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Tenant-Id: 115d9f93613748fe825f46c46e59c1d1 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-DeleteServersTestJSON-1472969533 Apr 14 05:49:11 user devstack@n-api.service[61644]: X-User: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:11 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:49:11 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:49:11 user devstack@n-api.service[61644]: X-User-Id: c5ac7cb2e42e403b998381759f922e9f Apr 14 05:49:11 user devstack@n-api.service[61644]: X-User-Name: tempest-DeleteServersTestJSON-1472969533-project-member Apr 14 05:49:11 user devstack@n-api.service[61644]: method: > Apr 14 05:49:11 user devstack@n-api.service[61644]: exception: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61644]: action_args: {'id': '91642571-ef07-4990-bdf8-068203203d59'} Apr 14 05:49:11 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. Apr 14 05:49:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] Returning 404 to user: Instance 91642571-ef07-4990-bdf8-068203203d59 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b35b9b15-27bd-4915-a9a4-3b006b02d9f6 tempest-DeleteServersTestJSON-1472969533 tempest-DeleteServersTestJSON-1472969533-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59" status: 404 len: 111 microversion: 2.1 time: 0.042396 Apr 14 05:49:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:11 2023] GET /compute/v2.1/servers/91642571-ef07-4990-bdf8-068203203d59 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-99148708-d18b-4fa0-b18c-f66de7333ded tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048540 Apr 14 05:49:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 71/216] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:49:12 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-72581710-edd3-48b5-aa67-55275c7d2b14 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Apr 14 05:49:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:49:12 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1103ec76-0134-4834-b063-c0ff90b3a4ac tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 204 len: 0 microversion: 2.32 time: 0.176075 Apr 14 05:49:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 73/218] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:49:12 2023] DELETE /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lazy-loading 'services' on Instance uuid a7fd3290-73e1-438e-9301-4a668e50c3be {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4790aa7e-7b3f-49d9-9dd9-6cf2eb4d9ac0 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/5d5e24bd-9225-4eb3-8359-d4c380c66e0d" status: 202 len: 0 microversion: 2.1 time: 0.207159 Apr 14 05:49:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 72/219] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:49:12 2023] DELETE /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments/5d5e24bd-9225-4eb3-8359-d4c380c66e0d => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-47f5ed0c-9fdc-4071-b1bb-bbe70cf02c9e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067360 Apr 14 05:49:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 74/220] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:49:12 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-deleted", "tag": "b28d3b9e-1e32-47c0-9117-75dd980cf186"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-deleted", "tag": "9411547c-6ef0-4706-b74c-cf4f2d3e59a9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Creating event network-vif-deleted:b28d3b9e-1e32-47c0-9117-75dd980cf186 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] Creating event network-vif-deleted:9411547c-6ef0-4706-b74c-cf4f2d3e59a9 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:12 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7c09793a3c314acc93ba7c04d67117d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea91450b53a4089beb572b96e80a902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b87394f3-fb16-42a2-9ad1-e7f0c8db41ba tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 200 len: 2946 microversion: 2.32 time: 0.307712 Apr 14 05:49:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 75/221] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:12 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 2946 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-93e9a866-7890-48c8-b412-700f4f969911 req-1a674cf2-d92d-465e-a143-ddf3f0546483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097843 Apr 14 05:49:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 73/222] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] Creating event network-vif-unplugged:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ba751357-389d-4511-9160-294a35e39487 req-f8a49893-8acd-463f-a9d3-0c31b85784e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052308 Apr 14 05:49:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 75/223] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] Creating event network-vif-unplugged:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-063ddb50-8d94-4f2e-9833-a279225d4026 req-81e87f9c-9060-4e90-9b3e-7575b01e75d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041735 Apr 14 05:49:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 76/224] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-deleted", "tag": "a161f793-130d-4fcf-8f39-163ca065ebbb"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "dac3f3ff-eeab-49f2-a538-061dc6d4afc8"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}, {"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-deleted", "tag": "e8d96b7d-3503-458c-a3d6-614617cf0a6e"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-unplugged:dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-deleted:a161f793-130d-4fcf-8f39-163ca065ebbb for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-plugged:dac3f3ff-eeab-49f2-a538-061dc6d4afc8 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-unplugged:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-plugged:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] Creating event network-vif-deleted:e8d96b7d-3503-458c-a3d6-614617cf0a6e for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-e8328657-ff29-4fd1-9186-9832639b0b97 req-26df3c8e-256f-4dcb-b91f-d4d577cd29f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.098935 Apr 14 05:49:15 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 74/225] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Creating event network-vif-plugged:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Creating event network-vif-unplugged:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] Creating event network-vif-plugged:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-d7610bce-65bb-4270-9791-cb47619e3ce1 req-dcb5dd2e-d461-4e6b-aacc-da6fcee047a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047056 Apr 14 05:49:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "5864d2bf-030a-4e87-a76c-49ca62310068"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "5864d2bf-030a-4e87-a76c-49ca62310068"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-unplugged", "status": "completed", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-plugged", "status": "completed", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Creating event network-vif-plugged:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Creating event network-vif-unplugged:5864d2bf-030a-4e87-a76c-49ca62310068 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Creating event network-vif-plugged:5864d2bf-030a-4e87-a76c-49ca62310068 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Creating event network-vif-unplugged:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] Creating event network-vif-plugged:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-80beeedf-b99c-405c-a8bd-cd94f9ccfc53 req-f7440cc2-6b89-4fef-8e1d-3b95a2b93415 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.089107 Apr 14 05:49:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 77/227] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72d95729-7692-4774-b0fe-5747f558d7d6", "name": "network-vif-deleted", "tag": "6a5445f4-3781-433f-821c-d24cceffd920"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] Creating event network-vif-deleted:6a5445f4-3781-433f-821c-d24cceffd920 for instance 72d95729-7692-4774-b0fe-5747f558d7d6 on user Apr 14 05:49:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b9ce2ebf-fbfd-466e-bbae-32155b41e7f6 req-3444f54e-b4db-45cf-8a25-ed299e77e813 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032430 Apr 14 05:49:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 75/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-deleted", "tag": "a33e4c43-ab16-4660-b246-9da472bef9a2"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-deleted", "tag": "369eac45-a5df-4204-a809-3ba92cada623"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-deleted", "tag": "aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-deleted", "tag": "c5c6cc3c-0e1a-4108-b219-4159953b3d3e"}, {"server_uuid": "921a3289-c406-4305-8e9b-8d218461c75c", "name": "network-vif-deleted", "tag": "8e0efe93-278b-45a0-9ff4-bdf2f96775d0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Creating event network-vif-deleted:a33e4c43-ab16-4660-b246-9da472bef9a2 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Creating event network-vif-deleted:369eac45-a5df-4204-a809-3ba92cada623 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Creating event network-vif-deleted:aaa77d8a-caf5-43b8-8ffd-2aa0d8705c64 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Creating event network-vif-deleted:c5c6cc3c-0e1a-4108-b219-4159953b3d3e for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] Creating event network-vif-deleted:8e0efe93-278b-45a0-9ff4-bdf2f96775d0 for instance 921a3289-c406-4305-8e9b-8d218461c75c on user Apr 14 05:49:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-a2aba58f-f67e-42e9-8f0d-788f038583a9 req-b82f8528-6c25-4d01-9579-31c93d35c8b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034038 Apr 14 05:49:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c678f9ca-de07-46c1-b151-12d230f04b45 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: .version_select at 0x7f55e2a17400>, body: {"keypair": {"name": "tempest-keypair-435197988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAzit3q31nZxCzBi+2n/KE067vOv7kl3jyUj1GjBXSUmP2NhcdddpMzUefF8FMOARSWoddbWaRkyYysRiskQaGhwfW8emDeoJwkgJcxnjcfhLz+flJghiCpP1w9zLtCFw=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:24 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-c678f9ca-de07-46c1-b151-12d230f04b45 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:49:24 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-c678f9ca-de07-46c1-b151-12d230f04b45 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for user 3aa9911d299b409f9ccc8a55e7b3ec5b and project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:49:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c678f9ca-de07-46c1-b151-12d230f04b45 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170119 Apr 14 05:49:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 78/230] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:49:23 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-680332699", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d288d2c3-a523-4004-913b-b2eb8a3e32c6"}], "security_groups": [{"name": "tempest-securitygroup--2143848755"}], "key_name": "tempest-keypair-435197988", "user_data": "}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:25 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] validate_networks() for [('d288d2c3-a523-4004-913b-b2eb8a3e32c6', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for user 3aa9911d299b409f9ccc8a55e7b3ec5b and project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:49:26 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:49:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0be12000-b09f-4e58-b6ed-36c74f4ad869 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.576897 Apr 14 05:49:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 76/231] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:49:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:49:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c6c974f3-4895-46a8-9179-ea086c41d3c5 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:26 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c6c974f3-4895-46a8-9179-ea086c41d3c5 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:26 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c6c974f3-4895-46a8-9179-ea086c41d3c5 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c6c974f3-4895-46a8-9179-ea086c41d3c5 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1230 microversion: 2.1 time: 0.334811 Apr 14 05:49:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 78/232] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:26 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1230 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=34 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] Creating event network-changed:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:49:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-752763ff-1468-49b8-b8b2-9ed042e9c20c req-e6704b2b-9ea5-484b-8c5a-2c7d9a7a32c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032072 Apr 14 05:49:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 79/233] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:30 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:49:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-fd4f59cb-4c53-44c2-b482-cc527f0925e4 req-83490c9a-efde-4639-aa62-b69d32b94168 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030327 Apr 14 05:49:30 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:32 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:32 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:32 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:49:32 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-51fcc2f3-6aef-4b41-9faa-ca157b822c62 req-936f199f-46d0-4fe3-a35c-d2daf2daf147 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045124 Apr 14 05:49:32 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 79/235] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] [instance: 1dc51328-8af2-4ddf-88e1-40cbba7a2823] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] HTTP exception thrown: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Request method failure captured: Apr 14 05:49:33 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 HTTP/1.1 Apr 14 05:49:33 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:49:33 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:49:33 user devstack@n-api.service[61645]: Connection: close Apr 14 05:49:33 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:49:33 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:49:33 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:49:33 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:49:33 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOi9mz8QIqo1REHutqSB1OMdYfc6d_zI8cBR0FYV_B-SmhljswqraVMRUeUviNWU6wbhXztdk4joZJQvXJHbhEDYILnR1XFEWAc-S-Se8HwRMw9n3W6d1epyNk1w8kWb_7otFaj4RX75V4UG8ZW7g3uGvMQ812XcPTtYS5bU8lJdm9U Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Project-Id: 6e9e42476ce14c31a05897a4a738ffd4 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesActionsTest-2128027182 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e9e42476ce14c31a05897a4a738ffd4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e9e42476ce14c31a05897a4a738ffd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e9e42476ce14c31a05897a4a738ffd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesActionsTest-2128027182 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Tenant-Id: 6e9e42476ce14c31a05897a4a738ffd4 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesActionsTest-2128027182 Apr 14 05:49:33 user devstack@n-api.service[61645]: X-User: tempest-VolumesActionsTest-2128027182-project-member Apr 14 05:49:33 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:49:33 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:49:33 user devstack@n-api.service[61645]: X-User-Id: 00dda4002041403eade471624793359c Apr 14 05:49:33 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesActionsTest-2128027182-project-member Apr 14 05:49:33 user devstack@n-api.service[61645]: method: > Apr 14 05:49:33 user devstack@n-api.service[61645]: exception: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. Apr 14 05:49:33 user devstack@n-api.service[61645]: action_args: {'id': '1dc51328-8af2-4ddf-88e1-40cbba7a2823'} Apr 14 05:49:33 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. Apr 14 05:49:33 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] Returning 404 to user: Instance 1dc51328-8af2-4ddf-88e1-40cbba7a2823 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e10cae22-46bf-4c3a-8e78-47df264274a3 tempest-VolumesActionsTest-2128027182 tempest-VolumesActionsTest-2128027182-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823" status: 404 len: 111 microversion: 2.1 time: 0.037856 Apr 14 05:49:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:33 2023] GET /compute/v2.1/servers/1dc51328-8af2-4ddf-88e1-40cbba7a2823 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9cd01538-bada-429f-802a-682a373a4e04 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073087 Apr 14 05:49:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 78/237] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:49:37 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:49:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-962541278", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "706e7dfb-b047-4c7c-921f-5e7cac4901df"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] validate_networks() for [('706e7dfb-b047-4c7c-921f-5e7cac4901df', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for project 0538df9180154c65a4405779a49914b3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Getting quotas for user 9c0ba3adada84bb0975af922caaaa2bc and project 0538df9180154c65a4405779a49914b3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:49:38 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:49:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a4138db3-e511-459b-a8da-9f9f600fc8a0 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.523406 Apr 14 05:49:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 80/238] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:49:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:49:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fb0cf819-bc09-4f27-891f-77b2ca9e9c2e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-fb0cf819-bc09-4f27-891f-77b2ca9e9c2e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-fb0cf819-bc09-4f27-891f-77b2ca9e9c2e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-fb0cf819-bc09-4f27-891f-77b2ca9e9c2e tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494" status: 200 len: 1211 microversion: 2.1 time: 0.072984 Apr 14 05:49:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:38 2023] GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 => generated 1211 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:41 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:41 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] Creating event network-changed:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:49:41 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a22a28c1-6ff2-4949-9291-e796be920b94 req-a47930e1-d3bd-4f9d-b76d-237de5711f86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029943 Apr 14 05:49:41 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 79/240] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:42 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] HTTP exception thrown: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Request method failure captured: Apr 14 05:49:42 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae HTTP/1.1 Apr 14 05:49:42 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:49:42 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:49:42 user devstack@n-api.service[61644]: Connection: close Apr 14 05:49:42 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:49:42 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:49:42 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:49:42 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:49:42 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOikPUH1XXnmArUjsrQxFIpAEgHUgwGHsd3zEXVZ20WDBOkMvn0SnLMI0SsAcaxmNf7NrKjI3rSBulT3pH1ybZ21hxBySnpWKGxpiLZdGhjyjA5OSlpe09GiuW4i961njCmZKAnzrjwVeMVvU2ZCJf6c9NvC7lxKiKpyW3gMU-ZBSvI Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Project-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dec916486c6643bebea6707752266f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Tenant-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:42 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:42 user devstack@n-api.service[61644]: X-User: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:42 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:49:42 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:49:42 user devstack@n-api.service[61644]: X-User-Id: 4b3721f81d2a41dc9493325afb204147 Apr 14 05:49:42 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:42 user devstack@n-api.service[61644]: method: > Apr 14 05:49:42 user devstack@n-api.service[61644]: exception: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:42 user devstack@n-api.service[61644]: action_args: {'id': '4f0881a2-86a2-40e5-8c3a-1ca12da65aae'} Apr 14 05:49:42 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:42 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:49:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Returning 404 to user: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:42 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-69aff279-4093-43a2-b285-df8ea4dffbca tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 404 len: 111 microversion: 2.1 time: 0.030453 Apr 14 05:49:42 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 81/241] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:42 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:42 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-87932c19-e37d-4cff-9eb7-aec70f4a380e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '.version_select at 0x7f55e2de72e0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:42 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-87932c19-e37d-4cff-9eb7-aec70f4a380e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242182190" status: 202 len: 0 microversion: 2.1 time: 0.025543 Apr 14 05:49:42 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 82/242] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 05:49:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242182190 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "name": "network-vif-plugged", "status": "completed", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] Creating event network-vif-plugged:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:49:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b5863973-ea40-429f-bc4e-6b4dcf5a4215 req-c3a72285-8b8f-4766-96f7-cfe5d6dd7382 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035831 Apr 14 05:49:43 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 80/243] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d021ec91-308b-40d3-a01d-b2d04d1462b6 tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834" status: 200 len: 503 microversion: 2.49 time: 0.054555 Apr 14 05:49:43 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 05:49:43 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 => generated 503 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-acef79da-c2d6-4b93-ac30-5925095eaf1c tempest-TaggedAttachmentsTest-1015961708 tempest-TaggedAttachmentsTest-1015961708-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834" status: 200 len: 503 microversion: 2.49 time: 0.102726 Apr 14 05:49:43 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 83/245] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 05:49:43 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-instance-actions/req-8c19810c-40a7-4f1d-8a7a-bc7681e0d834 => generated 503 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c10e0d0f-0709-46be-a179-13c97bd6df47 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.063960 Apr 14 05:49:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 81/246] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 05:49:43 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:49:44 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9c5c8190-0b88-41c7-8451-89bb1de3a27f tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 204 len: 0 microversion: 2.49 time: 0.158603 Apr 14 05:49:44 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:49:44 2023] DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:44 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a1d16c8d82ea4d38b34bef8f1a9e9f92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f62071417bf445d8982419fb3cfb625', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5c9e1f04-5643-4114-9422-fc7b572b8f96 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 200 len: 1753 microversion: 2.49 time: 0.346515 Apr 14 05:49:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 84/248] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:44 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 1753 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:49:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-unplugged", "status": "completed", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] Creating event network-vif-unplugged:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:49:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-c57e42cc-3156-436d-951f-16c21c61cb35 req-57f03219-591b-4776-90ba-50be35cbd3d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048198 Apr 14 05:49:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-baaa042b-71d7-4202-9367-39a96ab50236 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 200 len: 1379 microversion: 2.1 time: 0.270551 Apr 14 05:49:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 84/250] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:44 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 1379 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "name": "network-vif-plugged", "status": "completed", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] Creating event network-vif-plugged:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:49:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ecccf6c1-f830-4daf-b135-26cc994c019d req-45b9d036-8dc9-42d7-849c-6e4d97340b5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054026 Apr 14 05:49:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:45 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ebbeb984-c665-4d89-aad7-a0749d121d18 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 200 len: 1379 microversion: 2.1 time: 0.235520 Apr 14 05:49:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 85/252] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:45 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 1379 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:49:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7935bc0f-89de-49d7-886b-483d2b443900 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 204 len: 0 microversion: 2.1 time: 0.133829 Apr 14 05:49:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:49:45 2023] DELETE /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:46 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:49:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8d4ba288-8c73-43f5-84b2-0e5b73519d91 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 200 len: 1385 microversion: 2.1 time: 0.298646 Apr 14 05:49:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 84/254] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:45 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 1385 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:49:46 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-plugged", "status": "completed", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}, {"server_uuid": "b91c97cd-ba56-4cd7-845d-28e6c9f37836", "name": "network-vif-deleted", "tag": "b5264ebc-31b1-434f-b555-abcbebb4c6e2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:46 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Creating event network-vif-plugged:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:49:46 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] Creating event network-vif-deleted:b5264ebc-31b1-434f-b555-abcbebb4c6e2 for instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 on user Apr 14 05:49:46 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c243ef7d-099a-4f3d-8d98-4d4e3ea37df2 req-90e8e6c9-4984-49e6-8a62-25deafb71de9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063225 Apr 14 05:49:46 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "name": "network-vif-unplugged", "status": "completed", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}, {"server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "name": "network-vif-plugged", "status": "completed", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Creating event network-vif-unplugged:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:49:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] Creating event network-vif-plugged:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:49:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-77dad978-be14-4c44-a7f2-cf395089d7db req-be4e1231-58dc-4e1a-927d-cb254d9099c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037582 Apr 14 05:49:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:47 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] HTTP exception thrown: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Request method failure captured: Apr 14 05:49:47 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae HTTP/1.1 Apr 14 05:49:47 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:49:47 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:49:47 user devstack@n-api.service[61646]: Connection: close Apr 14 05:49:47 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:49:47 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:49:47 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:49:47 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:49:47 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOikPUH1XXnmArUjsrQxFIpAEgHUgwGHsd3zEXVZ20WDBOkMvn0SnLMI0SsAcaxmNf7NrKjI3rSBulT3pH1ybZ21hxBySnpWKGxpiLZdGhjyjA5OSlpe09GiuW4i961njCmZKAnzrjwVeMVvU2ZCJf6c9NvC7lxKiKpyW3gMU-ZBSvI Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Project-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dec916486c6643bebea6707752266f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Tenant-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:47 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61646]: X-User: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:47 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:49:47 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:49:47 user devstack@n-api.service[61646]: X-User-Id: 4b3721f81d2a41dc9493325afb204147 Apr 14 05:49:47 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:47 user devstack@n-api.service[61646]: method: > Apr 14 05:49:47 user devstack@n-api.service[61646]: exception: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61646]: action_args: {'id': '4f0881a2-86a2-40e5-8c3a-1ca12da65aae'} Apr 14 05:49:47 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Returning 404 to user: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0af5bcb8-7214-4f28-a5d3-723fc8650d7c tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 404 len: 111 microversion: 2.1 time: 0.036498 Apr 14 05:49:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:49:47 2023] DELETE /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] [instance: 4f0881a2-86a2-40e5-8c3a-1ca12da65aae] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] HTTP exception thrown: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Request method failure captured: Apr 14 05:49:47 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae HTTP/1.1 Apr 14 05:49:47 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:49:47 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:49:47 user devstack@n-api.service[61645]: Connection: close Apr 14 05:49:47 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:49:47 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:49:47 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:49:47 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:49:47 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOikPUH1XXnmArUjsrQxFIpAEgHUgwGHsd3zEXVZ20WDBOkMvn0SnLMI0SsAcaxmNf7NrKjI3rSBulT3pH1ybZ21hxBySnpWKGxpiLZdGhjyjA5OSlpe09GiuW4i961njCmZKAnzrjwVeMVvU2ZCJf6c9NvC7lxKiKpyW3gMU-ZBSvI Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Project-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dec916486c6643bebea6707752266f8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dec916486c6643bebea6707752266f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Tenant-Id: dec916486c6643bebea6707752266f8d Apr 14 05:49:47 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-568843138 Apr 14 05:49:47 user devstack@n-api.service[61645]: X-User: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:47 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:49:47 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:49:47 user devstack@n-api.service[61645]: X-User-Id: 4b3721f81d2a41dc9493325afb204147 Apr 14 05:49:47 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-568843138-project-member Apr 14 05:49:47 user devstack@n-api.service[61645]: method: > Apr 14 05:49:47 user devstack@n-api.service[61645]: exception: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61645]: action_args: {'id': '4f0881a2-86a2-40e5-8c3a-1ca12da65aae'} Apr 14 05:49:47 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. Apr 14 05:49:47 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:49:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] Returning 404 to user: Instance 4f0881a2-86a2-40e5-8c3a-1ca12da65aae could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8aa794f0-19c8-4a6d-9c1f-20ebfa1b226e tempest-AttachSCSIVolumeTestJSON-568843138 tempest-AttachSCSIVolumeTestJSON-568843138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae" status: 404 len: 111 microversion: 2.1 time: 0.046723 Apr 14 05:49:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:49:47 2023] GET /compute/v2.1/servers/4f0881a2-86a2-40e5-8c3a-1ca12da65aae => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e607038-6c40-417e-8c4f-f73f691e8672", "name": "network-vif-deleted", "tag": "0d477ae1-6e7f-4888-8f7d-8d53a41f225c"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] Creating event network-vif-deleted:0d477ae1-6e7f-4888-8f7d-8d53a41f225c for instance 5e607038-6c40-417e-8c4f-f73f691e8672 on user Apr 14 05:49:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-26f94ed9-6edc-45ae-b7d1-04a764aba27b req-54bf69c8-f8dd-4b26-b9a4-898b3570223a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049047 Apr 14 05:49:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 87/259] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:49:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HTTP exception thrown: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Request method failure captured: Apr 14 05:49:56 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 HTTP/1.1 Apr 14 05:49:56 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:49:56 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:49:56 user devstack@n-api.service[61646]: Connection: close Apr 14 05:49:56 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:49:56 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:49:56 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:49:56 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:49:56 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOiaF_hyMgcSGF85PPvZGFA2OL2yjuJoAAxZvZBRzzEKlfhPtU0Wacwu_WjehWI5837LaDOcfMgMrne_2nBuRB8CZpWVpj979lriWpq_i8nfv_ct2LRWv_t1QfZ8MvzVrTR8hBYdjnhCzFhqkq9M9GQ_QZmCorpuvB9HV4UzC4JV6aQ Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Project-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Tenant-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:49:56 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-User: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:49:56 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:49:56 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:49:56 user devstack@n-api.service[61646]: X-User-Id: 837f8d05577c40488c01fb21472b8870 Apr 14 05:49:56 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:49:56 user devstack@n-api.service[61646]: method: > Apr 14 05:49:56 user devstack@n-api.service[61646]: exception: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:49:56 user devstack@n-api.service[61646]: action_args: {'id': '72d95729-7692-4774-b0fe-5747f558d7d6'} Apr 14 05:49:56 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:49:56 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:49:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Returning 404 to user: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:49:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8eac1d5b-51ba-492a-9405-92797189c343 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 404 len: 111 microversion: 2.42 time: 0.038229 Apr 14 05:49:56 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 86/260] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:49:56 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:49:56 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3c803c6d-08bd-47eb-8526-23b2bc1bf432 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '.version_select at 0x7f55e2a144c0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:49:56 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:49:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3c803c6d-08bd-47eb-8526-23b2bc1bf432 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-980831644" status: 204 len: 0 microversion: 2.42 time: 0.041678 Apr 14 05:49:56 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 88/261] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 05:49:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-980831644 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HTTP exception thrown: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Request method failure captured: Apr 14 05:50:00 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 HTTP/1.1 Apr 14 05:50:00 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:00 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:00 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:00 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:00 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:00 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:00 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:00 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOiaF_hyMgcSGF85PPvZGFA2OL2yjuJoAAxZvZBRzzEKlfhPtU0Wacwu_WjehWI5837LaDOcfMgMrne_2nBuRB8CZpWVpj979lriWpq_i8nfv_ct2LRWv_t1QfZ8MvzVrTR8hBYdjnhCzFhqkq9M9GQ_QZmCorpuvB9HV4UzC4JV6aQ Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Project-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Tenant: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Tenant-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:50:00 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-User: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:50:00 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:00 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:00 user devstack@n-api.service[61644]: X-User-Id: 837f8d05577c40488c01fb21472b8870 Apr 14 05:50:00 user devstack@n-api.service[61644]: X-User-Name: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:50:00 user devstack@n-api.service[61644]: method: > Apr 14 05:50:00 user devstack@n-api.service[61644]: exception: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61644]: action_args: {'id': '72d95729-7692-4774-b0fe-5747f558d7d6'} Apr 14 05:50:00 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Returning 404 to user: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f16ed29c-30fb-4ad3-9f71-be747d60c50b tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 404 len: 111 microversion: 2.42 time: 0.038746 Apr 14 05:50:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 88/262] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:50:00 2023] DELETE /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] [instance: 72d95729-7692-4774-b0fe-5747f558d7d6] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] HTTP exception thrown: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Request method failure captured: Apr 14 05:50:00 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 HTTP/1.1 Apr 14 05:50:00 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:00 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:00 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:00 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:00 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:00 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:00 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:00 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOiaF_hyMgcSGF85PPvZGFA2OL2yjuJoAAxZvZBRzzEKlfhPtU0Wacwu_WjehWI5837LaDOcfMgMrne_2nBuRB8CZpWVpj979lriWpq_i8nfv_ct2LRWv_t1QfZ8MvzVrTR8hBYdjnhCzFhqkq9M9GQ_QZmCorpuvB9HV4UzC4JV6aQ Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Project-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d2a45bad5274464a0b89b9e275e515e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Tenant-Id: 4d2a45bad5274464a0b89b9e275e515e Apr 14 05:50:00 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-735316383 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-User: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:50:00 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:00 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:00 user devstack@n-api.service[61646]: X-User-Id: 837f8d05577c40488c01fb21472b8870 Apr 14 05:50:00 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedBootDevicesTest_v242-735316383-project-member Apr 14 05:50:00 user devstack@n-api.service[61646]: method: > Apr 14 05:50:00 user devstack@n-api.service[61646]: exception: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61646]: action_args: {'id': '72d95729-7692-4774-b0fe-5747f558d7d6'} Apr 14 05:50:00 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. Apr 14 05:50:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] Returning 404 to user: Instance 72d95729-7692-4774-b0fe-5747f558d7d6 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4bad721c-99ce-4e3e-b9fc-37f0174bda87 tempest-TaggedBootDevicesTest_v242-735316383 tempest-TaggedBootDevicesTest_v242-735316383-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6" status: 404 len: 111 microversion: 2.42 time: 0.033226 Apr 14 05:50:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 87/263] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:00 2023] GET /compute/v2.1/servers/72d95729-7692-4774-b0fe-5747f558d7d6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=24 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4b79db54-29b7-460a-867c-a25ee3fb9da8 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047616 Apr 14 05:50:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:50:02 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HTTP exception thrown: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Request method failure captured: Apr 14 05:50:02 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c HTTP/1.1 Apr 14 05:50:02 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:02 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:02 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:02 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:02 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:02 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:02 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:02 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOifIX6QuFZkBT_22b8Y3ApvGnLOD_GBcv3qeLaolshdCHMLXSD3YCq9O0j-_g2kdvAQHM4GCXlUu0qQRbkRVdJKJPjvUBrRUzdKzhFK1IMT7dNYc3C9-LIPUQG-0gZOxTYIx9BiqttD6XaqmXcHyelUgnu_TP2G6zNULZ8SpRwT7lU Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Project-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Tenant-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-User: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:02 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:02 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:02 user devstack@n-api.service[61646]: X-User-Id: 7c09793a3c314acc93ba7c04d67117d0 Apr 14 05:50:02 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:02 user devstack@n-api.service[61646]: method: > Apr 14 05:50:02 user devstack@n-api.service[61646]: exception: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:02 user devstack@n-api.service[61646]: action_args: {'id': '921a3289-c406-4305-8e9b-8d218461c75c'} Apr 14 05:50:02 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Returning 404 to user: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3c02a61d-bedd-4948-9aec-16540c8211d4 tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 404 len: 111 microversion: 2.32 time: 0.032316 Apr 14 05:50:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 88/265] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:02 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:02 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-38e2d186-f3c4-4b4c-b4ed-4ed251d9125b tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '.version_select at 0x7f55e2a17d00>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-38e2d186-f3c4-4b4c-b4ed-4ed251d9125b tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547240992" status: 204 len: 0 microversion: 2.32 time: 0.032713 Apr 14 05:50:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 90/266] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 05:50:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547240992 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:50:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c2b0897c-1577-4f22-a008-93ab64a4b058 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be" status: 204 len: 0 microversion: 2.1 time: 0.143811 Apr 14 05:50:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 89/267] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:50:02 2023] DELETE /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:03 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81250be3e69f4c68b8f583fe5f4284ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dfd3e43c5734eb08d516280486d4beb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a73adbef-cb3c-4043-8dd7-c683d0285238 tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be" status: 200 len: 1649 microversion: 2.1 time: 0.226544 Apr 14 05:50:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 89/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:02 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be => generated 1649 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "name": "network-vif-unplugged", "status": "completed", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] Creating event network-vif-unplugged:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:50:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-970d8c48-1c86-481f-a366-afd40a6d3df2 req-cab72324-6042-4583-8e61-ff3e6853b09c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045568 Apr 14 05:50:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 91/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e0bedf91-8953-44d4-b313-884edc4ea665 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1672 microversion: 2.1 time: 0.307098 Apr 14 05:50:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 90/270] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:04 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1672 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "name": "network-vif-deleted", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] Creating event network-vif-deleted:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:50:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-682f30a6-7b91-4b06-b9db-7e523dbdc6be req-03cf919e-c696-44e6-a84d-1640a3a57dd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039352 Apr 14 05:50:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 90/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7fd3290-73e1-438e-9301-4a668e50c3be", "name": "network-vif-plugged", "status": "completed", "tag": "fd4d27b7-aa72-41ed-8d91-6410737250a7"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] Creating event network-vif-plugged:fd4d27b7-aa72-41ed-8d91-6410737250a7 for instance a7fd3290-73e1-438e-9301-4a668e50c3be on user Apr 14 05:50:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-d1b4e6e9-4b50-46cc-b04c-316e96bbbcde req-4b90ada9-7505-450b-82eb-a099038c0bae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046564 Apr 14 05:50:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a56f41ad-da8e-4775-8732-5b826bb38c7a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: .version_select at 0x7f55e2a0d5a0>, body: {"keypair": {"name": "tempest-keypair-1417329181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPD8RR/MXsr73U6E444PVtrgNrPdCCTH4RWjomjXjHxW2wSulD9GhjzDqJBH1L2kZm8JKbhhDzZOX+USbsm/JWzQtiZMhfScVGIoyCJ/BXIUdnRB7W6UoB0Q8LgoWJaYQ=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:06 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a56f41ad-da8e-4775-8732-5b826bb38c7a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for project a335a6c17041473ca2abf256cb30a25f. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:50:06 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a56f41ad-da8e-4775-8732-5b826bb38c7a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for user e7fece08f6f649bb89fc8ae5121bc2cc and project a335a6c17041473ca2abf256cb30a25f. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:50:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a56f41ad-da8e-4775-8732-5b826bb38c7a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.204632 Apr 14 05:50:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 91/273] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 05:50:06 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ef50ac6-649b-4f1e-a49a-38c762ee04ad"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5badbeb4-2aa8-4f70-b36a-09166a4bbe41 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385386 Apr 14 05:50:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 91/274] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:50:06 2023] POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-553121458", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "77dc8e6f-e239-4937-ad9a-eb68543f6e86"}], "security_groups": [{"name": "tempest-securitygroup--1883079397"}], "key_name": "tempest-keypair-1417329181", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:08 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] validate_networks() for [('77dc8e6f-e239-4937-ad9a-eb68543f6e86', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:50:08 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for project a335a6c17041473ca2abf256cb30a25f. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for user e7fece08f6f649bb89fc8ae5121bc2cc and project a335a6c17041473ca2abf256cb30a25f. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:50:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7dd3a98d-420c-4c78-b19e-dde9e4280c2b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.997895 Apr 14 05:50:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 93/275] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:50:08 2023] POST /compute/v2.1/servers => generated 400 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:50:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:09 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:09 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:09 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:09 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-17f31a48-c0f7-4d9a-b999-c14b925adc03 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1275 microversion: 2.20 time: 0.089238 Apr 14 05:50:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 92/276] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:09 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=28 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HTTP exception thrown: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Request method failure captured: Apr 14 05:50:09 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c HTTP/1.1 Apr 14 05:50:09 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:09 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:09 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:09 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:09 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:09 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:09 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:09 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOifIX6QuFZkBT_22b8Y3ApvGnLOD_GBcv3qeLaolshdCHMLXSD3YCq9O0j-_g2kdvAQHM4GCXlUu0qQRbkRVdJKJPjvUBrRUzdKzhFK1IMT7dNYc3C9-LIPUQG-0gZOxTYIx9BiqttD6XaqmXcHyelUgnu_TP2G6zNULZ8SpRwT7lU Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Project-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Tenant-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-User: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:09 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:09 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:09 user devstack@n-api.service[61646]: X-User-Id: 7c09793a3c314acc93ba7c04d67117d0 Apr 14 05:50:09 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:09 user devstack@n-api.service[61646]: method: > Apr 14 05:50:09 user devstack@n-api.service[61646]: exception: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61646]: action_args: {'id': '921a3289-c406-4305-8e9b-8d218461c75c'} Apr 14 05:50:09 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Returning 404 to user: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-1b263364-9e80-456a-b00c-a2480c49baed tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 404 len: 111 microversion: 2.32 time: 0.054444 Apr 14 05:50:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 92/277] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:50:09 2023] DELETE /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] [instance: 921a3289-c406-4305-8e9b-8d218461c75c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] HTTP exception thrown: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Request method failure captured: Apr 14 05:50:09 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c HTTP/1.1 Apr 14 05:50:09 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:50:09 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:50:09 user devstack@n-api.service[61645]: Connection: close Apr 14 05:50:09 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:50:09 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:50:09 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:50:09 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:50:09 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOifIX6QuFZkBT_22b8Y3ApvGnLOD_GBcv3qeLaolshdCHMLXSD3YCq9O0j-_g2kdvAQHM4GCXlUu0qQRbkRVdJKJPjvUBrRUzdKzhFK1IMT7dNYc3C9-LIPUQG-0gZOxTYIx9BiqttD6XaqmXcHyelUgnu_TP2G6zNULZ8SpRwT7lU Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Project-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Project-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ea91450b53a4089beb572b96e80a902"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Tenant: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Tenant-Id: 3ea91450b53a4089beb572b96e80a902 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TaggedBootDevicesTest-507690907 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-User: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:09 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:50:09 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:50:09 user devstack@n-api.service[61645]: X-User-Id: 7c09793a3c314acc93ba7c04d67117d0 Apr 14 05:50:09 user devstack@n-api.service[61645]: X-User-Name: tempest-TaggedBootDevicesTest-507690907-project-member Apr 14 05:50:09 user devstack@n-api.service[61645]: method: > Apr 14 05:50:09 user devstack@n-api.service[61645]: exception: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61645]: action_args: {'id': '921a3289-c406-4305-8e9b-8d218461c75c'} Apr 14 05:50:09 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. Apr 14 05:50:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] Returning 404 to user: Instance 921a3289-c406-4305-8e9b-8d218461c75c could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5ea7d282-bfc3-4413-bca4-f7d7d64106de tempest-TaggedBootDevicesTest-507690907 tempest-TaggedBootDevicesTest-507690907-project-member] 10.0.0.210 "GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c" status: 404 len: 111 microversion: 2.32 time: 0.038602 Apr 14 05:50:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 94/278] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:09 2023] GET /compute/v2.1/servers/921a3289-c406-4305-8e9b-8d218461c75c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] Creating event network-changed:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:50:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-53f9450f-dd25-4352-ae7d-a08950cc9183 req-308811cf-2f93-485c-a7f8-aeb4d6dcdd78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027554 Apr 14 05:50:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 93/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:50:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1d7c87dc-644d-4f24-90e6-b43660c256a8 req-97ab873e-d177-4739-be4a-e8b3486c0f3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031776 Apr 14 05:50:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 93/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "f852b07b-a23b-4c28-bc31-15d3f7023dc2"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:15 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'flavor' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:50:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-0f2a81ad-5848-4a3f-983e-02113099e591 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action" status: 200 len: 29 microversion: 2.1 time: 0.338263 Apr 14 05:50:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 95/281] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:50:15 2023] POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action => generated 29 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:15 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-cd1768fd-b7a1-4d81-98bb-30e9514d469b tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1724 microversion: 2.1 time: 0.298235 Apr 14 05:50:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 94/282] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:15 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-unplugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:16 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] Creating event network-vif-unplugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:50:16 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-613893be-d2eb-4de7-adda-4830a1433806 req-cfce0da7-1428-409a-adcd-565b6829786f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041473 Apr 14 05:50:16 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 94/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:50:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-c8d41555-ce69-4a69-bfd4-ea48382dd593 req-be67d019-159d-466f-92ab-b99210cb66a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060264 Apr 14 05:50:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 95/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4e5323bc-6d55-411b-aca7-d798793a3ab4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1537 microversion: 2.1 time: 0.332700 Apr 14 05:50:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:16 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1537 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:50:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-732c8562-90c1-4c07-88ce-3939809695ee req-e5131e80-d8e0-4194-9859-304af3771a91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118266 Apr 14 05:50:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 95/286] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:50:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f85a2a15-96be-4357-b126-2fda65cb039c req-d4e749b7-a7f6-4486-9357-5966ebe2c3c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046674 Apr 14 05:50:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 96/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:50:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e0a0deed-5912-405c-9836-be323e99f8c6 req-190222e7-1e7c-4d50-8437-f358671c37b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061529 Apr 14 05:50:23 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=7 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=7 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:28 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-31707799-2d2e-42b7-b579-23025d061e48 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494" status: 200 len: 1495 microversion: 2.1 time: 0.220783 Apr 14 05:50:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 96/289] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:28 2023] GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 => generated 1495 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:50:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2114465759", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "32a1c0e8-4373-44b0-ae89-f5594311013e"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:31 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:31 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] validate_networks() for [('32a1c0e8-4373-44b0-ae89-f5594311013e', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting quotas for project e242403698514922aad5ec97ae17b1c8. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting quotas for user 92aac6d019db4be3bfe3016653ccc7a0 and project e242403698514922aad5ec97ae17b1c8. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:50:32 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:50:32 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-922f1c20-cf79-4160-8c45-e1001a554316 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.567410 Apr 14 05:50:32 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 97/290] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:50:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:50:32 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-27dc43a2-f960-4aca-b5f4-c4c12526ce34 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:32 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-27dc43a2-f960-4aca-b5f4-c4c12526ce34 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:32 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-27dc43a2-f960-4aca-b5f4-c4c12526ce34 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:32 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-27dc43a2-f960-4aca-b5f4-c4c12526ce34 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5" status: 200 len: 1213 microversion: 2.1 time: 0.076736 Apr 14 05:50:32 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:32 2023] GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] HTTP exception thrown: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Request method failure captured: Apr 14 05:50:34 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 HTTP/1.1 Apr 14 05:50:34 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:34 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:34 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:34 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:34 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:34 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:34 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:34 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOijr5P2_G7N6ryDUY0piHsky5EuVs3qp7KElgWhjhxPELM5y0uND2xTgwDBEpZ35zwyidE_VfpbFN0P3bLpemB2rJOlqZ2BnaDbpOccYiPtTPb3fhhyT5Yx1r0pE1gBbvW2XSzCfMsnsIvQufaWkZJLa_CjndW7rX68j5eAtKqTYaY Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Project-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Tenant-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-User: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:34 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:34 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:34 user devstack@n-api.service[61646]: X-User-Id: a1d16c8d82ea4d38b34bef8f1a9e9f92 Apr 14 05:50:34 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:34 user devstack@n-api.service[61646]: method: > Apr 14 05:50:34 user devstack@n-api.service[61646]: exception: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:34 user devstack@n-api.service[61646]: action_args: {'id': 'b91c97cd-ba56-4cd7-845d-28e6c9f37836'} Apr 14 05:50:34 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:34 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Returning 404 to user: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5f7ac0e9-b647-4d1a-9896-577da53db7f9 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 404 len: 111 microversion: 2.49 time: 0.070672 Apr 14 05:50:34 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 97/292] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:34 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c5f8f554-0cc6-449d-a9b7-84ccdfa14b8e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '.version_select at 0x7f55e2a0eef0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:34 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c5f8f554-0cc6-449d-a9b7-84ccdfa14b8e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158582486" status: 204 len: 0 microversion: 2.49 time: 0.050542 Apr 14 05:50:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 98/293] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 05:50:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158582486 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:50:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f03d7319-c393-4db7-8e8c-c9bc9a7205c8 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a57880>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f03d7319-c393-4db7-8e8c-c9bc9a7205c8 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/76cbee16-e398-4ee1-9056-160aa0ac05fd" status: 200 len: 351 microversion: 2.1 time: 0.116323 Apr 14 05:50:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:35 2023] GET /compute/v2.1/os-volumes/76cbee16-e398-4ee1-9056-160aa0ac05fd => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1574771686", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:35 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] validate_networks() for [('49b7a0c9-3ca2-4c36-af90-eb33b55fde50', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:50:36 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 HTTP/1.1 Apr 14 05:50:36 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:36 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:36 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:36 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:36 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:36 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:36 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:36 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61644]: method: > Apr 14 05:50:36 user devstack@n-api.service[61644]: exception: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: action_args: {'id': '5e607038-6c40-417e-8c4f-f73f691e8672'} Apr 14 05:50:36 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-db9595d7-09df-4361-96b1-33bef1439079 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 404 len: 111 microversion: 2.1 time: 0.040752 Apr 14 05:50:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:36 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:50:36 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 HTTP/1.1 Apr 14 05:50:36 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:50:36 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:50:36 user devstack@n-api.service[61645]: Connection: close Apr 14 05:50:36 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:50:36 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:50:36 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:50:36 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:50:36 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61645]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:50:36 user devstack@n-api.service[61645]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61645]: method: > Apr 14 05:50:36 user devstack@n-api.service[61645]: exception: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61645]: action_args: {'id': '5e607038-6c40-417e-8c4f-f73f691e8672'} Apr 14 05:50:36 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a64558e3-ba2d-4bc5-b6ec-36e260ed832a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 404 len: 111 microversion: 2.1 time: 0.042663 Apr 14 05:50:36 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:50:36 2023] DELETE /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 5e607038-6c40-417e-8c4f-f73f691e8672] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:50:36 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 HTTP/1.1 Apr 14 05:50:36 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:36 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:36 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:36 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:36 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:36 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:36 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:36 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:50:36 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:50:36 user devstack@n-api.service[61644]: method: > Apr 14 05:50:36 user devstack@n-api.service[61644]: exception: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: action_args: {'id': '5e607038-6c40-417e-8c4f-f73f691e8672'} Apr 14 05:50:36 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. Apr 14 05:50:36 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 5e607038-6c40-417e-8c4f-f73f691e8672 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-37c66c54-b639-4112-bc52-dc14629eee5a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672" status: 404 len: 111 microversion: 2.1 time: 0.073752 Apr 14 05:50:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 100/297] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:36 2023] GET /compute/v2.1/servers/5e607038-6c40-417e-8c4f-f73f691e8672 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for user c4946885e01a4f0da206d796027b3c9f and project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:50:36 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:50:36 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-47ad1284-44dc-4398-beae-3753fe68b4f0 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.905741 Apr 14 05:50:36 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 98/298] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:50:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:36 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-607b5386-1e75-473a-9c53-dc9e46bb4532 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 200 len: 1395 microversion: 2.87 time: 0.089945 Apr 14 05:50:36 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:36 2023] GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 1395 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] Creating event network-changed:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:50:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-91877c98-bcdc-463a-9f8f-9f65091d97de req-55d5156c-b02d-44fb-9c33-648d69fe9cdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055564 Apr 14 05:50:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] HTTP exception thrown: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Request method failure captured: Apr 14 05:50:37 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 HTTP/1.1 Apr 14 05:50:37 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:37 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:37 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:37 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:37 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:37 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:37 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:37 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOijr5P2_G7N6ryDUY0piHsky5EuVs3qp7KElgWhjhxPELM5y0uND2xTgwDBEpZ35zwyidE_VfpbFN0P3bLpemB2rJOlqZ2BnaDbpOccYiPtTPb3fhhyT5Yx1r0pE1gBbvW2XSzCfMsnsIvQufaWkZJLa_CjndW7rX68j5eAtKqTYaY Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Project-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Project-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Tenant: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Tenant-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-User: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:37 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:37 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:37 user devstack@n-api.service[61646]: X-User-Id: a1d16c8d82ea4d38b34bef8f1a9e9f92 Apr 14 05:50:37 user devstack@n-api.service[61646]: X-User-Name: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:37 user devstack@n-api.service[61646]: method: > Apr 14 05:50:37 user devstack@n-api.service[61646]: exception: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61646]: action_args: {'id': 'b91c97cd-ba56-4cd7-845d-28e6c9f37836'} Apr 14 05:50:37 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Returning 404 to user: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2562829d-281a-4809-b1b6-1dac6e786356 tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 404 len: 111 microversion: 2.49 time: 0.048032 Apr 14 05:50:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 99/301] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:50:37 2023] DELETE /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] [instance: b91c97cd-ba56-4cd7-845d-28e6c9f37836] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] HTTP exception thrown: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Request method failure captured: Apr 14 05:50:37 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 HTTP/1.1 Apr 14 05:50:37 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:50:37 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:50:37 user devstack@n-api.service[61645]: Connection: close Apr 14 05:50:37 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:50:37 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:50:37 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:50:37 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:50:37 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOijr5P2_G7N6ryDUY0piHsky5EuVs3qp7KElgWhjhxPELM5y0uND2xTgwDBEpZ35zwyidE_VfpbFN0P3bLpemB2rJOlqZ2BnaDbpOccYiPtTPb3fhhyT5Yx1r0pE1gBbvW2XSzCfMsnsIvQufaWkZJLa_CjndW7rX68j5eAtKqTYaY Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Project-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Project-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5f62071417bf445d8982419fb3cfb625"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Tenant: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Tenant-Id: 5f62071417bf445d8982419fb3cfb625 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1560780204 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-User: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:37 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:50:37 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:50:37 user devstack@n-api.service[61645]: X-User-Id: a1d16c8d82ea4d38b34bef8f1a9e9f92 Apr 14 05:50:37 user devstack@n-api.service[61645]: X-User-Name: tempest-TaggedAttachmentsTest-1560780204-project-member Apr 14 05:50:37 user devstack@n-api.service[61645]: method: > Apr 14 05:50:37 user devstack@n-api.service[61645]: exception: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61645]: action_args: {'id': 'b91c97cd-ba56-4cd7-845d-28e6c9f37836'} Apr 14 05:50:37 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. Apr 14 05:50:37 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] Returning 404 to user: Instance b91c97cd-ba56-4cd7-845d-28e6c9f37836 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-1fade531-e04c-4149-bd58-ef6c11e0cc7e tempest-TaggedAttachmentsTest-1560780204 tempest-TaggedAttachmentsTest-1560780204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836" status: 404 len: 111 microversion: 2.49 time: 0.032846 Apr 14 05:50:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:37 2023] GET /compute/v2.1/servers/b91c97cd-ba56-4cd7-845d-28e6c9f37836 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 05:50:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a94812cf-bb76-42c6-95f0-6329356de870 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a0e710>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a94812cf-bb76-42c6-95f0-6329356de870 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/54f93fac-92cd-4aa7-aa1a-0a101a29c193" status: 200 len: 350 microversion: 2.1 time: 0.066928 Apr 14 05:50:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:38 2023] GET /compute/v2.1/os-volumes/54f93fac-92cd-4aa7-aa1a-0a101a29c193 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:39 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "name": "network-vif-plugged", "status": "completed", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:39 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] Creating event network-vif-plugged:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:50:39 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-d5d60d58-fdf2-41e8-93b6-c20929ed1837 req-362a9c7b-df52-44d5-998d-57db6723c328 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042216 Apr 14 05:50:39 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 100/304] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] Creating event network-changed:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 05:50:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e4e9f576-acb2-4de5-bee3-f0f666b6e616 req-f38c5d8a-cf68-424f-843a-e9261e2f084a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059063 Apr 14 05:50:40 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 103/305] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:40 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5e2e6182-90d3-45ef-a1dc-6cf95e4a555c tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a0e050>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:40 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5e2e6182-90d3-45ef-a1dc-6cf95e4a555c tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/959e8693-f1fb-4955-b3b9-3a1363cf3d30" status: 200 len: 351 microversion: 2.1 time: 0.085771 Apr 14 05:50:40 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:40 2023] GET /compute/v2.1/os-volumes/959e8693-f1fb-4955-b3b9-3a1363cf3d30 => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:40 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-738997b9-585a-49d7-b0ee-4c237a3719e0 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2ba6a70>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-738997b9-585a-49d7-b0ee-4c237a3719e0 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.119757 Apr 14 05:50:40 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 101/307] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 05:50:40 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b4afdfcf-72b5-43c9-9737-a73781119cd1 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a57d00>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b4afdfcf-72b5-43c9-9737-a73781119cd1 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.122422 Apr 14 05:50:41 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 05:50:40 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a27c9ba8-48ce-4fac-abf5-45d1b14ca128 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2dc2170>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a27c9ba8-48ce-4fac-abf5-45d1b14ca128 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.121892 Apr 14 05:50:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ec13ea43-e200-4889-888d-5862d9e0a0e2 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2bf5870>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "name": "network-vif-plugged", "status": "completed", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] Creating event network-vif-plugged:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:50:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-7eb4dcab-29e8-4c0a-82d1-fc7ed26723d1 req-39045c9e-ba0e-4c79-96d3-0563c2409edb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045895 Apr 14 05:50:41 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 105/310] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ec13ea43-e200-4889-888d-5862d9e0a0e2 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.134528 Apr 14 05:50:41 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 102/311] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-860d5dc9-a0d4-43ba-bc06-a6293e3a103b tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a0e320>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-860d5dc9-a0d4-43ba-bc06-a6293e3a103b tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.116557 Apr 14 05:50:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3b6aaa3c-eb31-472d-875b-08a26beafdff tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a17be0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3b6aaa3c-eb31-472d-875b-08a26beafdff tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.156612 Apr 14 05:50:41 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 106/313] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3bcf8b55-47c8-4f39-83d3-bd06a1525d28 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2dadea0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3bcf8b55-47c8-4f39-83d3-bd06a1525d28 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.132721 Apr 14 05:50:41 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 103/314] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c73b910b-ddf2-48a6-90e2-f0c19fa425f0 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] Calling method '.version_select at 0x7f55e2a0d510>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c73b910b-ddf2-48a6-90e2-f0c19fa425f0 tempest-VolumesTestJSON-286255209 tempest-VolumesTestJSON-286255209-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089675 Apr 14 05:50:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 05:50:41 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:42 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "name": "network-vif-plugged", "status": "completed", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:42 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:42 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:42 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:42 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] Creating event network-vif-plugged:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 05:50:42 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c5035f93-e8d0-4016-8d16-50a76b990c3c req-78485c8e-eb99-40a8-b18a-ec09a9640efe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073799 Apr 14 05:50:42 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 107/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "name": "network-vif-plugged", "status": "completed", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] Creating event network-vif-plugged:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 05:50:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-0d595cc3-4019-4a9d-a34a-8e2f63533935 req-d1adbf5d-5fb2-455b-afc7-824d6f47e906 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033071 Apr 14 05:50:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1002232884", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "adbbc188-4e33-44fe-9723-30a4d276f9e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:47 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:50:48 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:50:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:50:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adbbc188-4e33-44fe-9723-30a4d276f9e7',volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:50:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-402969ae-6524-4c00-8737-92d71c7873b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.166126 Apr 14 05:50:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:50:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:50:48 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:48 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-67c2edb9-f016-4bdd-9d23-519b08ab5daf tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:48 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-67c2edb9-f016-4bdd-9d23-519b08ab5daf tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:48 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-67c2edb9-f016-4bdd-9d23-519b08ab5daf tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-67c2edb9-f016-4bdd-9d23-519b08ab5daf tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 200 len: 1066 microversion: 2.1 time: 0.131163 Apr 14 05:50:48 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 108/319] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:48 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 1066 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:50:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:51 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] Creating event network-changed:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:50:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-c259cce0-0f8f-4249-bb91-11a7862cc24b req-8325c3fb-8d61-4c45-98a8-4de5f959073a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040609 Apr 14 05:50:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 108/320] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d2f986be-25d7-4349-ae30-b724185e931f tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Action: 'create', calling method: .version_select at 0x7f55e2dafac0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1534801745", "metadata": {"Type": "work"}}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d2f986be-25d7-4349-ae30-b724185e931f tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.995504 Apr 14 05:50:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 105/321] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 05:50:51 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 997 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 05:50:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-abf6f104-3439-4cc3-a3d2-4954bfde84e4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e293c550>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:52 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-abf6f104-3439-4cc3-a3d2-4954bfde84e4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 353 microversion: 2.1 time: 0.371419 Apr 14 05:50:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 109/322] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:52 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 353 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] [instance: a7fd3290-73e1-438e-9301-4a668e50c3be] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] HTTP exception thrown: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Request method failure captured: Apr 14 05:50:53 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be HTTP/1.1 Apr 14 05:50:53 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:53 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:53 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:53 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:53 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:53 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:53 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:53 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOidZ8K69yIcPQHY0wYvdFY0ufEUIyXi1meOJTgRPp0rlw2YTQ6QYhWrkoFEq0TtkiE9VZ7b-cBSPN6gWO9HLyKWAsmOKUZfHC6OqZxK5NmBcwfg19PtEd4vUIb1qk4vNglbMuSJUo5AloyLeUzpJ04YPhfz4q8d5sy2VDUCNMn9spw Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Project-Id: 4dfd3e43c5734eb08d516280486d4beb Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeSwap-1588834662 Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4dfd3e43c5734eb08d516280486d4beb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4dfd3e43c5734eb08d516280486d4beb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4dfd3e43c5734eb08d516280486d4beb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeSwap-1588834662 Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Tenant-Id: 4dfd3e43c5734eb08d516280486d4beb Apr 14 05:50:53 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeSwap-1588834662 Apr 14 05:50:53 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeSwap-1588834662-project-member Apr 14 05:50:53 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:53 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:53 user devstack@n-api.service[61644]: X-User-Id: 81250be3e69f4c68b8f583fe5f4284ae Apr 14 05:50:53 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeSwap-1588834662-project-member Apr 14 05:50:53 user devstack@n-api.service[61644]: method: > Apr 14 05:50:53 user devstack@n-api.service[61644]: exception: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. Apr 14 05:50:53 user devstack@n-api.service[61644]: action_args: {'id': 'a7fd3290-73e1-438e-9301-4a668e50c3be'} Apr 14 05:50:53 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. Apr 14 05:50:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Returning 404 to user: Instance a7fd3290-73e1-438e-9301-4a668e50c3be could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-eb0a1633-3010-4d63-afb9-c2ac9d039c3e tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be" status: 404 len: 111 microversion: 2.1 time: 0.048935 Apr 14 05:50:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 109/323] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:50:53 2023] GET /compute/v2.1/servers/a7fd3290-73e1-438e-9301-4a668e50c3be => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d799bcdf-d712-4433-81f5-adb1b7ccb24d tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] Calling method '.version_select at 0x7f55e2ba71c0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d799bcdf-d712-4433-81f5-adb1b7ccb24d tempest-TestVolumeSwap-1588834662 tempest-TestVolumeSwap-1588834662-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132035066" status: 202 len: 0 microversion: 2.1 time: 0.028620 Apr 14 05:50:53 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 106/324] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 05:50:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132035066 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d3e9c678-b393-407c-9a40-b7af7d3b4f89 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2c2a440>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d3e9c678-b393-407c-9a40-b7af7d3b4f89 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 354 microversion: 2.1 time: 0.066576 Apr 14 05:50:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 110/325] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:54 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-680680b4-2b61-4e0c-8d68-9a3e10727743 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2a59120>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-be1f6a31-0125-4818-a88a-f97a3d014916 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Action: 'create', calling method: .version_select at 0x7f55e2bf7370>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-982071432", "metadata": {"Type": "work"}}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-be1f6a31-0125-4818-a88a-f97a3d014916 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Length: 121 Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: Apr 14 05:50:54 user devstack@n-api.service[61646]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-982071432", "metadata": {"Type": "work"}}} Apr 14 05:50:54 user devstack@n-api.service[61646]: method: Apr 14 05:50:54 user devstack@n-api.service[61646]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-982071432', 'metadata': {'Type': 'work'}}}} Apr 14 05:50:54 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise error Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-be1f6a31-0125-4818-a88a-f97a3d014916 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-be1f6a31-0125-4818-a88a-f97a3d014916 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.203279 Apr 14 05:50:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 107/326] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 05:50:54 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-11fb4c2d-fa1c-4ad8-9a43-82b74ea1a2c8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Action: 'create', calling method: .version_select at 0x7f55e2a56c20>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-747206017", "metadata": {"Type": "work"}}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-11fb4c2d-fa1c-4ad8-9a43-82b74ea1a2c8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61645]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61645]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61645]: Content-Length: 119 Apr 14 05:50:54 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61645]: Apr 14 05:50:54 user devstack@n-api.service[61645]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-747206017", "metadata": {"Type": "work"}}} Apr 14 05:50:54 user devstack@n-api.service[61645]: method: Apr 14 05:50:54 user devstack@n-api.service[61645]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 05:50:54 user devstack@n-api.service[61645]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-747206017', 'metadata': {'Type': 'work'}}}} Apr 14 05:50:54 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise error Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi '0' Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-680680b4-2b61-4e0c-8d68-9a3e10727743 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 354 microversion: 2.1 time: 0.373073 Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-11fb4c2d-fa1c-4ad8-9a43-82b74ea1a2c8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-11fb4c2d-fa1c-4ad8-9a43-82b74ea1a2c8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011848 Apr 14 05:50:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:54 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 354 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 111/328] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 05:50:54 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-14d4ceb0-7265-405f-b3e1-3d07f8c74b10 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Action: 'create', calling method: .version_select at 0x7f55e2bf4310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1972813560", "metadata": {"Type": "work"}}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-14d4ceb0-7265-405f-b3e1-3d07f8c74b10 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61646]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Length: 119 Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: Apr 14 05:50:54 user devstack@n-api.service[61646]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1972813560", "metadata": {"Type": "work"}}} Apr 14 05:50:54 user devstack@n-api.service[61646]: method: Apr 14 05:50:54 user devstack@n-api.service[61646]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1972813560', 'metadata': {'Type': 'work'}}}} Apr 14 05:50:54 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise error Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi '' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-14d4ceb0-7265-405f-b3e1-3d07f8c74b10 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-14d4ceb0-7265-405f-b3e1-3d07f8c74b10 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007921 Apr 14 05:50:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 108/329] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 05:50:54 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-575057d5-7ec0-498d-af91-77137aee955e tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Calling method '.version_select at 0x7f55e2a55ab0>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-aaab458e-c8e1-4c4e-abfe-9a0da857d150 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2d03c70>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-575057d5-7ec0-498d-af91-77137aee955e tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] HTTP exception thrown: Volume tempest-invalid-991515802 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-575057d5-7ec0-498d-af91-77137aee955e tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-991515802 HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61645]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:50:54 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61645]: method: Apr 14 05:50:54 user devstack@n-api.service[61645]: exception: Volume tempest-invalid-991515802 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61645]: action_args: {'id': 'tempest-invalid-991515802'} Apr 14 05:50:54 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-991515802 could not be found. (HTTP 404) (Request-ID: req-eaf16e33-10c8-42c9-b1e9-039d8f8aafdb) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-991515802 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-991515802 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-991515802 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-575057d5-7ec0-498d-af91-77137aee955e tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 404 to user: Volume tempest-invalid-991515802 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-575057d5-7ec0-498d-af91-77137aee955e tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-991515802" status: 404 len: 98 microversion: 2.1 time: 0.043541 Apr 14 05:50:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 112/330] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 05:50:54 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-991515802 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-65790552-7a89-4924-aadc-a2280408d266 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004299 Apr 14 05:50:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 109/331] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 05:50:54 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e77bf30a-1892-4706-a150-f71c1487310f tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004348 Apr 14 05:50:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 113/332] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 05:50:54 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6dde0746-3050-4b70-9f7d-1237143c905a tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Calling method '.version_select at 0x7f55e2bf7490>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-aaab458e-c8e1-4c4e-abfe-9a0da857d150 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 202 len: 0 microversion: 2.1 time: 0.108093 Apr 14 05:50:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 05:50:54 2023] DELETE /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-6dde0746-3050-4b70-9f7d-1237143c905a tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] HTTP exception thrown: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6dde0746-3050-4b70-9f7d-1237143c905a tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/os-volumes/4d67ed86-424a-4afa-bfde-4ce0268287ad HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61646]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:50:54 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61646]: method: Apr 14 05:50:54 user devstack@n-api.service[61646]: exception: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. Apr 14 05:50:54 user devstack@n-api.service[61646]: action_args: {'id': '4d67ed86-424a-4afa-bfde-4ce0268287ad'} Apr 14 05:50:54 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. (HTTP 404) (Request-ID: req-778d051f-98b2-46c0-ade0-92d4b23d3c9c) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. Apr 14 05:50:54 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6dde0746-3050-4b70-9f7d-1237143c905a tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 404 to user: Volume 4d67ed86-424a-4afa-bfde-4ce0268287ad could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-6dde0746-3050-4b70-9f7d-1237143c905a tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4d67ed86-424a-4afa-bfde-4ce0268287ad" status: 404 len: 109 microversion: 2.1 time: 0.036783 Apr 14 05:50:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 110/334] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 05:50:54 2023] DELETE /compute/v2.1/os-volumes/4d67ed86-424a-4afa-bfde-4ce0268287ad => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7db3c685-b6b0-4a86-9315-cd7f349848e9 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e293d480>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b4a36051-6431-4e2a-8735-8ebd2b9d2df8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Calling method '.version_select at 0x7f55e2dc2ef0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-b4a36051-6431-4e2a-8735-8ebd2b9d2df8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] HTTP exception thrown: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b4a36051-6431-4e2a-8735-8ebd2b9d2df8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Request method failure captured: Apr 14 05:50:54 user devstack@n-api.service[61644]: request: GET /compute/v2.1/os-volumes/6c2c5a89-81dd-4070-aea4-8f71af83b925 HTTP/1.1 Apr 14 05:50:54 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:54 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:54 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:54 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:54 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:54 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:54 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:54 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOm-aZVPWlQ_GQWrM7ET_23oN-YR53TqlMwemISBw2tbR7Mh0BRBkALOK9WO8zYWazCIVZpguk8PMNG5yCscwhLI79A3oagxXKaOL3cR7yqLTHYV3AKFyw3zknq8am4StlOz7143mzdbwtK9kEn9gy2rtYpZ2VheiMRz2YvejhE_TZg Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Project-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b50050c6215e428b850f4a3881d7c878"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Tenant-Id: b50050c6215e428b850f4a3881d7c878 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesNegativeTest-1317220046 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-User: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:54 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:54 user devstack@n-api.service[61644]: X-User-Id: 0eaf25893f6842ef9443fe5626b44777 Apr 14 05:50:54 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesNegativeTest-1317220046-project-member Apr 14 05:50:54 user devstack@n-api.service[61644]: method: Apr 14 05:50:54 user devstack@n-api.service[61644]: exception: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61644]: action_args: {'id': '6c2c5a89-81dd-4070-aea4-8f71af83b925'} Apr 14 05:50:54 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. (HTTP 404) (Request-ID: req-fd1af336-f3cf-4eda-a429-3845a9984a4f) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. Apr 14 05:50:54 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b4a36051-6431-4e2a-8735-8ebd2b9d2df8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] Returning 404 to user: Volume 6c2c5a89-81dd-4070-aea4-8f71af83b925 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b4a36051-6431-4e2a-8735-8ebd2b9d2df8 tempest-VolumesNegativeTest-1317220046 tempest-VolumesNegativeTest-1317220046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6c2c5a89-81dd-4070-aea4-8f71af83b925" status: 404 len: 109 microversion: 2.1 time: 0.044901 Apr 14 05:50:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:54 2023] GET /compute/v2.1/os-volumes/6c2c5a89-81dd-4070-aea4-8f71af83b925 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7db3c685-b6b0-4a86-9315-cd7f349848e9 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 353 microversion: 2.1 time: 0.063336 Apr 14 05:50:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 114/336] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:54 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:55 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=16 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2349f4b2-196f-4215-bac8-e353daafecde tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2bf7880>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2349f4b2-196f-4215-bac8-e353daafecde tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 353 microversion: 2.1 time: 0.101794 Apr 14 05:50:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 111/337] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:55 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8a5818aa-8cb0-4bd9-adfa-fa385502a2ef tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2a58ee0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8a5818aa-8cb0-4bd9-adfa-fa385502a2ef tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 353 microversion: 2.1 time: 0.054607 Apr 14 05:50:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:56 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ad4f5d45-e9f2-4e72-ae73-d9ff801e5ef8 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2a56c20>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ad4f5d45-e9f2-4e72-ae73-d9ff801e5ef8 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 200 len: 353 microversion: 2.1 time: 0.064562 Apr 14 05:50:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 115/339] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:57 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:50:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:50:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-784d7d71-5e71-459b-8d5a-551d261a2e44 req-b9dd937c-1107-4205-89ec-eace3b7a8289 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058975 Apr 14 05:50:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 112/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:50:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-377731eb-565b-489f-a7d0-73dd7c6724c4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Calling method '.version_select at 0x7f55e2e58dc0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-377731eb-565b-489f-a7d0-73dd7c6724c4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] HTTP exception thrown: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. Apr 14 05:50:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-377731eb-565b-489f-a7d0-73dd7c6724c4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Request method failure captured: Apr 14 05:50:59 user devstack@n-api.service[61644]: request: GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 HTTP/1.1 Apr 14 05:50:59 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:50:59 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:50:59 user devstack@n-api.service[61644]: Connection: close Apr 14 05:50:59 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:50:59 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:50:59 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:50:59 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:50:59 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOm7RYxFg84poPSERE2VgkBlJotPt5g5BItUvQFiFIvr-bVmsSU8pjbclp30578pL0jfrTO8IDgR9Hy2xGI2EE-yqSTiRIqBTavizlJpBqdn28gIr0UGOe3TaVKzClpbar26PGQFxxVwQd266F92uzv5Ei_Y-yfXAhy3BwAU0Pk_Q9g Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Project-Id: 7ca22f31eab34286b33fcc8581f70db7 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesGetTestJSON-1999555199 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ca22f31eab34286b33fcc8581f70db7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7ca22f31eab34286b33fcc8581f70db7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7ca22f31eab34286b33fcc8581f70db7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesGetTestJSON-1999555199 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Tenant-Id: 7ca22f31eab34286b33fcc8581f70db7 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesGetTestJSON-1999555199 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-User: tempest-VolumesGetTestJSON-1999555199-project-member Apr 14 05:50:59 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:50:59 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:50:59 user devstack@n-api.service[61644]: X-User-Id: b42020e6410740a8851b41bdcf9a4c29 Apr 14 05:50:59 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesGetTestJSON-1999555199-project-member Apr 14 05:50:59 user devstack@n-api.service[61644]: method: Apr 14 05:50:59 user devstack@n-api.service[61644]: exception: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. Apr 14 05:50:59 user devstack@n-api.service[61644]: action_args: {'id': '88e82d07-1f41-4218-8284-ccd46bdb20b0'} Apr 14 05:50:59 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. (HTTP 404) (Request-ID: req-519a5da5-d3f6-4651-ae2d-17cf392e20b4) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. Apr 14 05:50:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:50:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-377731eb-565b-489f-a7d0-73dd7c6724c4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] Returning 404 to user: Volume 88e82d07-1f41-4218-8284-ccd46bdb20b0 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:50:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-377731eb-565b-489f-a7d0-73dd7c6724c4 tempest-VolumesGetTestJSON-1999555199 tempest-VolumesGetTestJSON-1999555199-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0" status: 404 len: 109 microversion: 2.1 time: 0.044610 Apr 14 05:50:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 05:50:58 2023] GET /compute/v2.1/os-volumes/88e82d07-1f41-4218-8284-ccd46bdb20b0 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:59 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:50:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-40431421-a95d-47cf-8909-06a90da72087 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1587 microversion: 2.20 time: 0.240194 Apr 14 05:50:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 116/342] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:50:59 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1587 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:51:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:51:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-0503f0ea-abd9-46ef-ac29-cb033adafc79 req-9d5cb1c9-7526-46ea-971f-703dd5e31481 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046669 Apr 14 05:51:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 113/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:06 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f867d09d-5874-4f66-8982-f9e434042933 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1704 microversion: 2.1 time: 0.240972 Apr 14 05:51:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:05 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1704 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-65268f2f-79ab-4756-acd8-149a61a3498e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.213743 Apr 14 05:51:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:51:17 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-interface => generated 283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1248527205", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] validate_networks() for [('0af82dbe-8b33-44ba-9d0a-3653b2dcc439', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] Creating event network-changed:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:51:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-fa1d4687-a3bb-4a25-867a-d29e78efdd11 req-a8168e1d-f017-470b-a1ce-8aa130a0cd9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042884 Apr 14 05:51:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 116/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-69bcf86c-7004-42ae-9ebc-91e931539588 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/ips" status: 200 len: 105 microversion: 2.1 time: 0.042685 Apr 14 05:51:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 118/347] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 05:51:18 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/ips => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting quotas for project 289cfed4776048b18eca85457a194bfb. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting quotas for user 4e56c03cd09f4a3882e8dffbbaa40c97 and project 289cfed4776048b18eca85457a194bfb. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:51:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:51:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-6e09ed55-55f2-4303-a952-04870cb007fc tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.855170 Apr 14 05:51:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 114/348] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:51:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-93e52bf1-fba9-4512-b6f7-48acb817a521 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-93e52bf1-fba9-4512-b6f7-48acb817a521 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:18 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-93e52bf1-fba9-4512-b6f7-48acb817a521 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-93e52bf1-fba9-4512-b6f7-48acb817a521 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1211 microversion: 2.1 time: 0.081167 Apr 14 05:51:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:18 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:51:20 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5633694-9b3e-4f90-af91-b14d5be70916"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:20 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d3817d53-2e01-4c81-9ee5-f2fc4e94e8cc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311670 Apr 14 05:51:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 119/350] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:51:20 2023] POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:22 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] Creating event network-changed:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 05:51:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a7714465-18e5-4458-8298-4697a3fd8230 req-c7458805-1867-430e-b2d5-7a4774ad568e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036578 Apr 14 05:51:22 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 115/351] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:23 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c46d6ebd-6075-45ca-a467-a08216fa0955 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5" status: 200 len: 1496 microversion: 2.1 time: 0.530718 Apr 14 05:51:23 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:22 2023] GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 => generated 1496 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:51:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "name": "network-vif-plugged", "status": "completed", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] Creating event network-vif-plugged:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 05:51:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-48b6e9ea-5633-4414-af54-e7efafdb5b88 req-074dc660-5b34-4e17-81b8-a03e87ba061d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.286274 Apr 14 05:51:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 120/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:26 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "name": "network-vif-plugged", "status": "completed", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] Creating event network-vif-plugged:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 05:51:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-89d0509f-d075-4a9a-8fea-2cdf66b1f4af req-2e0d9011-1dea-4746-88bb-e0bf8b975d05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038887 Apr 14 05:51:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:26 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-81ceb93c-8a99-4ab4-9dec-7f3ea39665c9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 200 len: 1691 microversion: 2.87 time: 0.206811 Apr 14 05:51:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 119/355] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:51:26 2023] GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:51:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:29 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Going to try to stop instance {{(pid=61645) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 05:51:29 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b2df1c26-a30e-4934-b8e4-29df42329770 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action" status: 202 len: 0 microversion: 2.1 time: 0.137798 Apr 14 05:51:29 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 121/356] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:51:28 2023] POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:29 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7a2a0293-0282-49a6-b702-7fd322507783 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1712 microversion: 2.1 time: 0.258825 Apr 14 05:51:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 117/357] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:29 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1712 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:51:29 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-unplugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:29 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] Creating event network-vif-unplugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:51:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-fba7a03e-8a0f-4962-8805-517d9bbe2e1c req-476fa8e8-2155-4c56-bfba-b15e1fe1066a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074048 Apr 14 05:51:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 120/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "577ad7e9-9c9c-4752-8581-0199f75c4a35"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] HTTP exception thrown: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Request method failure captured: Apr 14 05:51:31 user devstack@n-api.service[61645]: request: PUT /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494/os-volume_attachments/b629578a-5c41-45b0-98e3-3298c8e0ebf7 HTTP/1.1 Apr 14 05:51:31 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:51:31 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:51:31 user devstack@n-api.service[61645]: Connection: close Apr 14 05:51:31 user devstack@n-api.service[61645]: Content-Length: 74 Apr 14 05:51:31 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:51:31 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:51:31 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:51:31 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOi9YymkPdMRyzHgq6162i67ORymfQ6KozY0uAo1x4dgPJ8aapd1dffebv_OnrkpsPveWjD5uhvXSzFDP7lNpmH5dnef2VRlSAD8h31K1-4742QFpyRIoVHcveGjhWL9rt3Tbmf_8y-9BYXZEFcHtxwHP11-feKojFEOusBcmT948mI Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Project-Id: 2a2288466c1349dd98e48e4e4b98a2f5 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Role: admin,member,reader Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Roles: admin,member,reader Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a2288466c1349dd98e48e4e4b98a2f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Tenant-Id: 2a2288466c1349dd98e48e4e4b98a2f5 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1549365854 Apr 14 05:51:31 user devstack@n-api.service[61645]: X-User: tempest-VolumesAdminNegativeTest-1549365854-project-admin Apr 14 05:51:31 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:51:31 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:51:31 user devstack@n-api.service[61645]: X-User-Id: 202a385d001a42179ab59fdf29dca70d Apr 14 05:51:31 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesAdminNegativeTest-1549365854-project-admin Apr 14 05:51:31 user devstack@n-api.service[61645]: Apr 14 05:51:31 user devstack@n-api.service[61645]: {"volumeAttachment": {"volumeId": "577ad7e9-9c9c-4752-8581-0199f75c4a35"}} Apr 14 05:51:31 user devstack@n-api.service[61645]: method: > Apr 14 05:51:31 user devstack@n-api.service[61645]: exception: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. Apr 14 05:51:31 user devstack@n-api.service[61645]: action_args: {'server_id': 'b4a09d25-305a-4c5f-96db-e5b07dfaa494', 'id': 'b629578a-5c41-45b0-98e3-3298c8e0ebf7', 'body': {'volumeAttachment': {'volumeId': '577ad7e9-9c9c-4752-8581-0199f75c4a35'}}} Apr 14 05:51:31 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. (HTTP 404) (Request-ID: req-d2ebf3bb-abdd-45e3-b613-d89707449141) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. Apr 14 05:51:31 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:51:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] Returning 404 to user: Volume b629578a-5c41-45b0-98e3-3298c8e0ebf7 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:51:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-04c1a64d-93d9-4ab9-a7b9-fe55721044a4 tempest-VolumesAdminNegativeTest-1549365854 tempest-VolumesAdminNegativeTest-1549365854-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494/os-volume_attachments/b629578a-5c41-45b0-98e3-3298c8e0ebf7" status: 404 len: 109 microversion: 2.1 time: 0.084834 Apr 14 05:51:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 122/359] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 05:51:31 2023] PUT /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494/os-volume_attachments/b629578a-5c41-45b0-98e3-3298c8e0ebf7 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:51:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:51:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1ddc5019-b002-478a-bd89-0aa536c55ce3 req-85d01411-6954-4786-92e2-ce56ec91431d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Apr 14 05:51:31 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 118/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:51:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-487e199e-8d56-43de-a912-e3d13b48ea15 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494" status: 204 len: 0 microversion: 2.1 time: 0.163505 Apr 14 05:51:35 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:51:34 2023] DELETE /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:35 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-13b1cfb1-6210-44c3-ba30-489b26d45aa5 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494" status: 200 len: 1501 microversion: 2.1 time: 0.375732 Apr 14 05:51:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 123/362] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:35 2023] GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 => generated 1501 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:51:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "name": "network-vif-unplugged", "status": "completed", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] Creating event network-vif-unplugged:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:51:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-c7dbed62-80b6-459c-9d5b-12a0b6fd1f07 req-b7cf6a85-17b7-4655-84c2-d6bd66c45a66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139243 Apr 14 05:51:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 119/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:36 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "name": "network-vif-deleted", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:36 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] Creating event network-vif-deleted:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:51:36 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f61829cc-a119-4b20-82c7-cd1e4dc66478 req-89080625-3373-419e-aee0-214575f5dc9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101317 Apr 14 05:51:36 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 122/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a09d25-305a-4c5f-96db-e5b07dfaa494", "name": "network-vif-plugged", "status": "completed", "tag": "0ceea987-cfef-4579-a50d-2a53ef497efa"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:51:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] Creating event network-vif-plugged:0ceea987-cfef-4579-a50d-2a53ef497efa for instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 on user Apr 14 05:51:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-1e887bba-4173-4292-a8d1-1329f3af6b69 req-3c0865a7-6cd1-4cd6-a3d9-ee47a33294b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030422 Apr 14 05:51:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 124/365] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:51:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-632082d1-a471-4c3c-a200-0e7f7c77bab3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 200 len: 1394 microversion: 2.1 time: 0.185049 Apr 14 05:51:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 120/366] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:51:38 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 1394 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:51:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:51:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9c1e43a4-734c-443d-b877-482356eff777 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.105919 Apr 14 05:51:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:51:59 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-interface => generated 282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=16 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] Creating event network-changed:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:52:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-96d3c9b5-787c-4936-bf2c-15cfeb4aa63f req-08139daa-9581-4c2d-8086-6ae3ea2995a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038679 Apr 14 05:52:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 125/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=22 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b657d7a9-f148-453b-8a27-706f6fa218c5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/ips" status: 200 len: 110 microversion: 2.20 time: 0.044467 Apr 14 05:52:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 121/369] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 05:52:00 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/ips => generated 110 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:02 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'flavor' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:52:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-734b50ec-b4af-43ef-84e1-55b73b77e13a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/action" status: 202 len: 0 microversion: 2.20 time: 0.888336 Apr 14 05:52:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 124/370] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:52:02 2023] POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:03 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d055f2c0-a566-4b77-a5c4-54c9b25cb398 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1712 microversion: 2.20 time: 0.224301 Apr 14 05:52:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 126/371] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:52:03 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1712 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 05:52:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] Creating event network-vif-unplugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:52:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-973f06c3-9ed7-45a8-bfa2-14dd2119c826 req-417c12c5-98ad-4c5f-8f9c-d791964b3f89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029096 Apr 14 05:52:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 122/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:52:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-3786c6b0-38d7-42dc-83dd-058f4973e722 req-a1df0b6f-a76e-4cc1-88ea-82ba118d88af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Apr 14 05:52:05 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5c69f515-8612-4c96-94ed-7c7ce5fc976c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.256328 Apr 14 05:52:06 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 127/374] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:52:06 2023] POST /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-27c47cf3-d9fc-4d5f-804d-7c9c690c2e13 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.100735 Apr 14 05:52:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:52:06 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-interface => generated 283 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-unplugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] Creating event network-vif-unplugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-07642dff-572c-4e09-87d1-1ea9802b859d req-511dd11d-6c95-4927-a1b2-de92d1d5c9c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043362 Apr 14 05:52:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 126/376] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] Creating event network-changed:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-18cc6989-d8d8-4fab-8e73-a79081be7627 req-33fbcfef-d3c1-41c0-b4b4-fdf79c66553f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Apr 14 05:52:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 128/377] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:09 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] Creating event network-changed:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:52:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-38e5383b-066d-4b7f-9f59-d8f40a4194d3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1493 microversion: 2.1 time: 0.216452 Apr 14 05:52:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 124/378] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:08 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1493 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-58787047-9090-4012-8e19-047440e8dd9b req-95533f04-adf3-47c1-82c6-3a6b7e8ad553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042167 Apr 14 05:52:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}, {"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-dcf70f18-bd8b-4aca-8e2a-d1bc5e155cb7 req-1671689d-aa78-44b5-92d2-56c6ba807546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042448 Apr 14 05:52:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] Creating event network-changed:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a53fd7db-95f6-46c6-ab6a-2a5d89d1a0b2 req-40d09e0e-a80a-4ead-a752-ada48c3dcaa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031449 Apr 14 05:52:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 125/381] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:52:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-a2a06c8e-0a5f-4d2d-ac8b-188ff1ac2329 req-8c057d64-1efd-4c48-9c5e-0b19346d0021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Apr 14 05:52:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 128/382] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:19 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-229baa27-45ad-41a9-8d78-2f44d177d2ef tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1689 microversion: 2.1 time: 0.186838 Apr 14 05:52:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 130/383] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:19 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=10 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=18 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79faff7e-a8ce-491e-843c-27e2a905be1a", "device": "/dev/vdb"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:23 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0fd4385d-140f-4638-aef2-7a661a552afc tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "POST /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337144 Apr 14 05:52:23 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 126/384] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:52:23 2023] POST /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=12 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: b4a09d25-305a-4c5f-96db-e5b07dfaa494] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] HTTP exception thrown: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Request method failure captured: Apr 14 05:52:25 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 HTTP/1.1 Apr 14 05:52:25 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:52:25 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:52:25 user devstack@n-api.service[61644]: Connection: close Apr 14 05:52:25 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:52:25 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:52:25 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:52:25 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:52:25 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOiin1Yu8G_8KV0lfB3fRT3qaD_u0RK10O5l3jJHrtOAXrghWck7lkQhgbtPeYFpGf6xRl3IJqskVtOmASH7z6103_21psH7wKM-QE33YRoodBQBPOi_xbcJqegVFyJyi36ocxsUJ9vbhkMRuaRP8Lyyiibz5bKl6Ape0AugzRPEPCk Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Project-Id: 0538df9180154c65a4405779a49914b3 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0538df9180154c65a4405779a49914b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0538df9180154c65a4405779a49914b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0538df9180154c65a4405779a49914b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Tenant-Id: 0538df9180154c65a4405779a49914b3 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:52:25 user devstack@n-api.service[61644]: X-User: tempest-VolumesAdminNegativeTest-881296749-project-member Apr 14 05:52:25 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:52:25 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:52:25 user devstack@n-api.service[61644]: X-User-Id: 9c0ba3adada84bb0975af922caaaa2bc Apr 14 05:52:25 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesAdminNegativeTest-881296749-project-member Apr 14 05:52:25 user devstack@n-api.service[61644]: method: > Apr 14 05:52:25 user devstack@n-api.service[61644]: exception: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. Apr 14 05:52:25 user devstack@n-api.service[61644]: action_args: {'id': 'b4a09d25-305a-4c5f-96db-e5b07dfaa494'} Apr 14 05:52:25 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. Apr 14 05:52:25 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:52:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Returning 404 to user: Instance b4a09d25-305a-4c5f-96db-e5b07dfaa494 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:52:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7f78449a-d598-46d2-b52e-c833d4064c46 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494" status: 404 len: 111 microversion: 2.1 time: 0.159485 Apr 14 05:52:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 129/385] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:25 2023] GET /compute/v2.1/servers/b4a09d25-305a-4c5f-96db-e5b07dfaa494 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lazy-loading 'services' on Instance uuid 4a200376-4747-49ed-96d4-3fe9ac338dcc {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:52:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f77abbcc-8fe1-4371-87ba-8ce0cd7b16f9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments/1ef50ac6-649b-4f1e-a49a-38c762ee04ad" status: 202 len: 0 microversion: 2.1 time: 0.178582 Apr 14 05:52:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 131/386] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:52:25 2023] DELETE /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments/1ef50ac6-649b-4f1e-a49a-38c762ee04ad => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-23d786c4-0fa1-4bf2-a124-170205da548f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065218 Apr 14 05:52:25 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 127/387] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:52:25 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1643000183"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-080aa781-abbd-45a1-82ac-fedece228af2 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37/action" status: 202 len: 52 microversion: 2.87 time: 0.972407 Apr 14 05:52:27 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 130/388] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:52:26 2023] POST /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37/action => generated 52 bytes in 975 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:52:29 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-90fff9e7-6a28-4075-add6-7febfa83ddfa tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403" status: 204 len: 0 microversion: 2.1 time: 0.175142 Apr 14 05:52:29 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 132/389] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:52:28 2023] DELETE /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:29 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c0ba3adada84bb0975af922caaaa2bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0538df9180154c65a4405779a49914b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d81dedc4-0d7c-4fbb-b33f-cbe84db2496a tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403" status: 200 len: 1668 microversion: 2.1 time: 0.223468 Apr 14 05:52:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:29 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 => generated 1668 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:29 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "name": "network-vif-unplugged", "status": "completed", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] Creating event network-vif-unplugged:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:52:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-0021bced-b5d0-4227-bc18-b69d42503fce req-a2810c6c-859c-4a4b-83bd-4158024879a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044238 Apr 14 05:52:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 131/391] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "name": "network-vif-plugged", "status": "completed", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] Creating event network-vif-plugged:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:52:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-606b2da3-c0f7-400f-aa82-dfb0cb68466e req-9c2cc149-364a-4b81-8e7f-507ed01177bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063150 Apr 14 05:52:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 133/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932e9aba-ecce-4d2e-8486-eb2e3c685403", "name": "network-vif-deleted", "tag": "a9abbeea-538e-4cf6-96b0-71fdeec1f2c3"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] Creating event network-vif-deleted:a9abbeea-538e-4cf6-96b0-71fdeec1f2c3 for instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 on user Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-4d75c875-8788-4df2-af67-35efac456763 req-9cee073d-facf-4bd5-9f37-8fafdc8c4e12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048027 Apr 14 05:52:33 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9c83abcf-73c1-4877-8322-f6db0ee60c59 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 200 len: 1691 microversion: 2.87 time: 0.409129 Apr 14 05:52:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 129/394] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:52:33 2023] GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 1691 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-746a4106-c381-4d3f-82a5-5d9c29a83607 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 200 len: 1394 microversion: 2.1 time: 0.176346 Apr 14 05:52:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 134/395] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:38 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 1394 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-407723315"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:39 user devstack@n-api.service[61644]: INFO nova.compute.api [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Attempting to quiesce instance before volume snapshot. Apr 14 05:52:39 user devstack@n-api.service[61644]: INFO nova.compute.api [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 05:52:39 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Creating snapshot from volume adbbc188-4e33-44fe-9723-30a4d276f9e7. {{(pid=61644) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 05:52:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c57f64e0-d607-410d-8ace-c24a2fa82e7e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4/action" status: 202 len: 0 microversion: 2.1 time: 2.575962 Apr 14 05:52:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 133/396] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:52:38 2023] POST /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4/action => generated 0 bytes in 2577 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 05:52:41 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-381474991", "imageRef": "d8eeaef1-eeb9-454d-bc23-87b68342c5c8", "flavorRef": "42", "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:41 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:52:42 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='388333c3-8208-4f69-88de-a8d33c7d4527',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:52:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9878949c-1847-4943-8af7-22a8a1a2afe6 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.981385 Apr 14 05:52:42 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 130/397] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:52:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:52:42 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6ae3a383-8e16-49ab-8533-be65201e0135 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:42 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6ae3a383-8e16-49ab-8533-be65201e0135 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:42 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-6ae3a383-8e16-49ab-8533-be65201e0135 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:42 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6ae3a383-8e16-49ab-8533-be65201e0135 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 200 len: 1223 microversion: 2.1 time: 0.066764 Apr 14 05:52:42 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 135/398] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:42 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 1223 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] Creating event network-changed:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:52:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f39528a3-665d-4113-bfcc-d156374df4a6 req-6dd82843-2f3b-4d70-879d-24bdadc1eea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Apr 14 05:52:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 134/399] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:50 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'services' on Instance uuid 91db166d-7af7-4aa7-90bd-a003048effa5 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:52:50 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-00e472e7-e98a-4073-a7ee-83c1cbb24d5e tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5/os-volume_attachments/79faff7e-a8ce-491e-843c-27e2a905be1a" status: 202 len: 0 microversion: 2.1 time: 0.162024 Apr 14 05:52:50 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 131/400] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:52:50 2023] DELETE /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5/os-volume_attachments/79faff7e-a8ce-491e-843c-27e2a905be1a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=7 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:52:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-fc35218a-a5de-4cb0-a6d4-fdf430ea2cb1 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5" status: 204 len: 0 microversion: 2.1 time: 0.124151 Apr 14 05:52:50 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 136/401] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:52:50 2023] DELETE /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:51 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d0e08256-412c-4f15-86bb-3270d63574f0 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5" status: 200 len: 1548 microversion: 2.1 time: 0.166369 Apr 14 05:52:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 135/402] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:52:50 2023] GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "name": "network-vif-unplugged", "status": "completed", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] Creating event network-vif-unplugged:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:52:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ebd3c271-dbd6-4410-8aab-3a35e010e172 req-66be392e-ad97-4f4d-b11e-7064fc9dff58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034042 Apr 14 05:52:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 132/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:53 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:52:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a512294c-83ea-4109-9bf8-faa510f7ad28 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1653 microversion: 2.20 time: 0.162248 Apr 14 05:52:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 137/404] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:52:53 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1653 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:52:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "name": "network-vif-deleted", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] Creating event network-vif-deleted:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:52:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-43ace8bc-ca0b-47b8-89d2-001b0370673e req-94c09fe0-ee28-48bc-adc7-9b3602d18247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036311 Apr 14 05:52:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 136/405] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91db166d-7af7-4aa7-90bd-a003048effa5", "name": "network-vif-plugged", "status": "completed", "tag": "eacc5441-0087-4493-832f-39661bf968e0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] Creating event network-vif-plugged:eacc5441-0087-4493-832f-39661bf968e0 for instance 91db166d-7af7-4aa7-90bd-a003048effa5 on user Apr 14 05:52:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-08eeb45f-878f-4517-9ba5-dcde89cc6f8b req-8460874e-9b26-444b-b584-1379e1f1280c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043884 Apr 14 05:52:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 133/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "name": "network-vif-plugged", "status": "completed", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] Creating event network-vif-plugged:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:52:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-4c6dbab5-4770-4b68-a4ce-19c88ec78f58 req-a8e33754-2230-40f3-ad22-84049bc15fc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050629 Apr 14 05:52:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 138/407] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "name": "network-vif-plugged", "status": "completed", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=17 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:52:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:52:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] Creating event network-vif-plugged:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:52:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-05ddfc66-68f5-4dff-82ad-54a8ab811a1a req-3d70f570-0aa4-4b41-821d-c6bd8de552e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037920 Apr 14 05:52:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:52:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-575067684", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] validate_networks() for [('0af82dbe-8b33-44ba-9d0a-3653b2dcc439', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting quotas for project 289cfed4776048b18eca85457a194bfb. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Getting quotas for user 4e56c03cd09f4a3882e8dffbbaa40c97 and project 289cfed4776048b18eca85457a194bfb. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:53:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:53:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5f477cdc-cfb9-4691-ab7a-71b9a1c404f0 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.483797 Apr 14 05:53:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 134/409] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:53:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:53:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-677ee9f7-30a6-4242-b96d-63817d7329c5 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-677ee9f7-30a6-4242-b96d-63817d7329c5 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-677ee9f7-30a6-4242-b96d-63817d7329c5 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-677ee9f7-30a6-4242-b96d-63817d7329c5 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 200 len: 1210 microversion: 2.1 time: 0.080454 Apr 14 05:53:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 139/410] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:09 2023] GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:12 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] Creating event network-changed:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:53:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-4dbe25da-1846-47c1-9a93-e14ffca77baa req-1baf52b7-430a-49bf-b7ba-2c35057a181c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041208 Apr 14 05:53:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 138/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "name": "network-vif-plugged", "status": "completed", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] Creating event network-vif-plugged:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:53:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-24dfadd3-a8ae-4704-a673-4a1527f23066 req-e18a5ef5-5c2c-45a5-a585-5e9b7f3d7674 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048261 Apr 14 05:53:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 135/412] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5c051049-4a03-4bde-b0ca-83e7d4fa7122 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047119 Apr 14 05:53:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 140/413] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:53:15 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:53:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "name": "network-vif-plugged", "status": "completed", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] Creating event network-vif-plugged:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:53:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-cc5edd20-dabc-44b9-883f-3e3a3ce4f4aa req-af1891a7-d02b-4652-b42e-13f23fe1fd44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Apr 14 05:53:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 139/414] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1e9b98e9-106d-4226-aeb4-187dbc64c999 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '.version_select at 0x7f55e2dadb40>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] [instance: 932e9aba-ecce-4d2e-8486-eb2e3c685403] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] HTTP exception thrown: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Request method failure captured: Apr 14 05:53:19 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 HTTP/1.1 Apr 14 05:53:19 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:53:19 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:53:19 user devstack@n-api.service[61645]: Connection: close Apr 14 05:53:19 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:53:19 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:53:19 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:53:19 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:53:19 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOiin1Yu8G_8KV0lfB3fRT3qaD_u0RK10O5l3jJHrtOAXrghWck7lkQhgbtPeYFpGf6xRl3IJqskVtOmASH7z6103_21psH7wKM-QE33YRoodBQBPOi_xbcJqegVFyJyi36ocxsUJ9vbhkMRuaRP8Lyyiibz5bKl6Ape0AugzRPEPCk Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Project-Id: 0538df9180154c65a4405779a49914b3 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Project-Name: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0538df9180154c65a4405779a49914b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0538df9180154c65a4405779a49914b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0538df9180154c65a4405779a49914b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Tenant: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Tenant-Id: 0538df9180154c65a4405779a49914b3 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-881296749 Apr 14 05:53:19 user devstack@n-api.service[61645]: X-User: tempest-VolumesAdminNegativeTest-881296749-project-member Apr 14 05:53:19 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:53:19 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:53:19 user devstack@n-api.service[61645]: X-User-Id: 9c0ba3adada84bb0975af922caaaa2bc Apr 14 05:53:19 user devstack@n-api.service[61645]: X-User-Name: tempest-VolumesAdminNegativeTest-881296749-project-member Apr 14 05:53:19 user devstack@n-api.service[61645]: method: > Apr 14 05:53:19 user devstack@n-api.service[61645]: exception: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. Apr 14 05:53:19 user devstack@n-api.service[61645]: action_args: {'id': '932e9aba-ecce-4d2e-8486-eb2e3c685403'} Apr 14 05:53:19 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. Apr 14 05:53:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Returning 404 to user: Instance 932e9aba-ecce-4d2e-8486-eb2e3c685403 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:53:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6e443803-ce20-47a4-a015-7d81690b6ac4 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403" status: 404 len: 111 microversion: 2.1 time: 0.042883 Apr 14 05:53:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 141/415] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:19 2023] GET /compute/v2.1/servers/932e9aba-ecce-4d2e-8486-eb2e3c685403 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-074e875b-eae9-4b00-9937-5b3d9a1a0c66 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] Calling method '.version_select at 0x7f55e2932440>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-074e875b-eae9-4b00-9937-5b3d9a1a0c66 tempest-VolumesAdminNegativeTest-881296749 tempest-VolumesAdminNegativeTest-881296749-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347509802" status: 202 len: 0 microversion: 2.1 time: 0.022573 Apr 14 05:53:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 140/416] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 05:53:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347509802 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-1e9b98e9-106d-4226-aeb4-187dbc64c999 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2" status: 204 len: 0 microversion: 2.1 time: 0.269522 Apr 14 05:53:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 136/417] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:19 2023] DELETE /compute/v2.1/images/f852b07b-a23b-4c28-bc31-15d3f7023dc2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-51980d65-8d7f-4614-aac6-b0b18eaa27d9 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 204 len: 0 microversion: 2.1 time: 0.181793 Apr 14 05:53:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:53:19 2023] DELETE /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Going to try to start instance {{(pid=61644) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 05:53:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9cbbffad-8c0d-4432-af52-8a3d3e3645ae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action" status: 202 len: 0 microversion: 2.1 time: 0.158644 Apr 14 05:53:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 141/419] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:53:19 2023] POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:19 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:20 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e733b69143e045bcbe99d823b02aab83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93092d7530694b63aba0a085051c0520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:20 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-152da297-f503-4f6f-9fdc-c2213689f09c tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 200 len: 1678 microversion: 2.1 time: 0.411523 Apr 14 05:53:20 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 137/420] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:19 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 1678 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-03e2d243-a6a9-485b-a815-eb1ebbec6f86 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1698 microversion: 2.1 time: 0.287403 Apr 14 05:53:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:19 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1698 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:20 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-unplugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] Creating event network-vif-unplugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:53:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ffe13a3d-672e-490a-b5cf-8512ca74bf90 req-eefaf1d8-d183-4841-9dbc-1d7beeea7471 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034949 Apr 14 05:53:20 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 142/422] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:53:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-deleted", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] Creating event network-vif-deleted:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:53:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-78394ba6-b414-4628-ab8b-e973e68b2ceb req-5a33ead4-43c5-49a2-aaad-b188c71203ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 Apr 14 05:53:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 138/423] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a200376-4747-49ed-96d4-3fe9ac338dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5de51fa-6654-4f76-89df-063a4d6ad4f0"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] Creating event network-vif-plugged:b5de51fa-6654-4f76-89df-063a4d6ad4f0 for instance 4a200376-4747-49ed-96d4-3fe9ac338dcc on user Apr 14 05:53:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-2c7b3c84-24f1-4e1b-9ffe-cba776585825 req-e107943f-c05c-4e26-8a13-e232fb06900d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031159 Apr 14 05:53:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:53:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-34fab332-f7ca-4b21-ba08-f946a5341496 req-3ca7785c-9df4-4485-86f0-5951e9e46941 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045344 Apr 14 05:53:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 143/425] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:27 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:27 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:53:27 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-fbd242b0-a264-4dd6-ba66-bd1613817a28 req-5c1764f7-acb6-4f38-87c7-17abd877ffaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Apr 14 05:53:27 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 139/426] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:33 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-0990f3d4-d2a9-4dd9-9a48-03f398c3608e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 200 len: 1550 microversion: 2.1 time: 0.351146 Apr 14 05:53:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:32 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 1550 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-793349449", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:33 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] validate_networks() for [('49b7a0c9-3ca2-4c36-af90-eb33b55fde50', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for user c4946885e01a4f0da206d796027b3c9f and project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:53:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:53:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8c987fe5-6b54-486f-b6f8-0e10c87e2a86 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.931539 Apr 14 05:53:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 144/428] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:53:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:53:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4c81508d-19f0-4593-9d32-a0ac0de93a29 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1394 microversion: 2.87 time: 0.147308 Apr 14 05:53:34 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 140/429] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:53:34 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1394 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:53:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3a8d236e-0256-4bcb-8120-4ddebce048fd tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: .version_select at 0x7f55e293f250>, body: {"keypair": {"name": "tempest-keypair-1592565508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5fXme0iDlZkvKFaWra9ajxG2a1w4PNa8evBnkJEodZ6+ec2PbE/FuEw+8xcMEgZ5aJGDUpXHhrA2hm95/ZaI0kkep9wM4Gm8aEaW3oO+WCEXrhfjdLkfkD14/tPG9l1A=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:37 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-3a8d236e-0256-4bcb-8120-4ddebce048fd tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:53:37 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-3a8d236e-0256-4bcb-8120-4ddebce048fd tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:53:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3a8d236e-0256-4bcb-8120-4ddebce048fd tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267723 Apr 14 05:53:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 146/430] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:53:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] Creating event network-changed:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:53:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-17e7ad69-a386-435e-84c1-47fcabe2c2cc req-b2ba690c-2f85-4ada-90ca-694716de21fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030347 Apr 14 05:53:37 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-493161134", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "120654f0-7376-4b69-9763-9e1631a23590"}], "security_groups": [{"name": "tempest-securitygroup--1087363977"}], "key_name": "tempest-keypair-1592565508", "user_data": "}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=15 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] validate_networks() for [('120654f0-7376-4b69-9763-9e1631a23590', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:53:39 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:53:39 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-bed489e0-0ee8-424e-9acb-5cf23c9f470c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.606498 Apr 14 05:53:39 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 141/432] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:53:38 2023] POST /compute/v2.1/servers => generated 407 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:53:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c1b624ed-6ed7-48d8-b3d1-10e9a41ead0f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:39 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c1b624ed-6ed7-48d8-b3d1-10e9a41ead0f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:39 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-c1b624ed-6ed7-48d8-b3d1-10e9a41ead0f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c1b624ed-6ed7-48d8-b3d1-10e9a41ead0f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1232 microversion: 2.1 time: 0.376419 Apr 14 05:53:39 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 147/433] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:39 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1232 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: 91db166d-7af7-4aa7-90bd-a003048effa5] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] HTTP exception thrown: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Request method failure captured: Apr 14 05:53:41 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 HTTP/1.1 Apr 14 05:53:41 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:53:41 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:53:41 user devstack@n-api.service[61644]: Connection: close Apr 14 05:53:41 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:53:41 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:53:41 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:53:41 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:53:41 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmgCTo1MdVje8ZupQVyuOKm2UV2Cbj_Z8BoKuvQ4itKuv1eG7YYSniVQUbirCTC_Uwn3P_oikzIJtD19820p0UWmJOupqUmqsaXmdPFNs80ONmeREyFNaY3zhJJCL8byfhZts6eIBeFMoVn0_FxCFaXi0qzG7WSsXAKqBdBgiTW-wc Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Project-Id: e242403698514922aad5ec97ae17b1c8 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Tenant-Id: e242403698514922aad5ec97ae17b1c8 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-User: tempest-VolumesSnapshotTestJSON-186190223-project-member Apr 14 05:53:41 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:53:41 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:53:41 user devstack@n-api.service[61644]: X-User-Id: 92aac6d019db4be3bfe3016653ccc7a0 Apr 14 05:53:41 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesSnapshotTestJSON-186190223-project-member Apr 14 05:53:41 user devstack@n-api.service[61644]: method: > Apr 14 05:53:41 user devstack@n-api.service[61644]: exception: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. Apr 14 05:53:41 user devstack@n-api.service[61644]: action_args: {'id': '91db166d-7af7-4aa7-90bd-a003048effa5'} Apr 14 05:53:41 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. Apr 14 05:53:41 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:53:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Returning 404 to user: Instance 91db166d-7af7-4aa7-90bd-a003048effa5 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:53:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d1c998cb-c95c-4d40-bc90-a65d8b1fdd54 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5" status: 404 len: 111 microversion: 2.1 time: 0.034175 Apr 14 05:53:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 146/434] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:41 2023] GET /compute/v2.1/servers/91db166d-7af7-4aa7-90bd-a003048effa5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:53:42 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] Creating event network-changed:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:53:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ab9280e4-7752-42bf-9036-d25aefc7cf65 req-ffb73daa-2569-4ece-841d-8142f10aacb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034394 Apr 14 05:53:42 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 142/435] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:53:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-84ab5337-59dd-4f93-bb6e-1a336a6dd605 req-4146d7c0-ef02-4a70-aca0-7bda7f4acea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046457 Apr 14 05:53:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 148/436] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:53:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-2395a93c-fc4c-454e-b607-683d22142b39 req-a2d2433c-d4b9-4dc5-91c7-147e25bec1fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043138 Apr 14 05:53:46 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:53:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-615df8fb-e993-4ee5-a96d-881c3fabdfad req-2a2595f9-ec91-4311-94be-57f6e617f086 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048398 Apr 14 05:53:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 143/438] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:53:51 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:53:51 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:51 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:53:51 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-786c0d42-a35e-499d-8097-aea634c3959d req-5f9cc717-8f6e-44db-9437-3933680a3996 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035861 Apr 14 05:53:51 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 149/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c444d6ac-de53-4cae-b3d6-7365fbc7c282"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f552274e-68a5-46cd-8701-ffb60cde9667 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311502 Apr 14 05:53:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 148/440] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 05:53:53 2023] POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61646) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 05:53:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4fbc692d-80e4-427c-a9b9-ce7e29296231 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/action" status: 202 len: 0 microversion: 2.20 time: 0.118651 Apr 14 05:53:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 144/441] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:53:54 2023] POST /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:54 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-888e46fc-d5c9-468e-b50b-589c2d2bb0e8 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1739 microversion: 2.20 time: 0.180323 Apr 14 05:53:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 150/442] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:53:54 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:53:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-105204178", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "32a1c0e8-4373-44b0-ae89-f5594311013e"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:54 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] validate_networks() for [('32a1c0e8-4373-44b0-ae89-f5594311013e', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting quotas for project e242403698514922aad5ec97ae17b1c8. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Getting quotas for user 92aac6d019db4be3bfe3016653ccc7a0 and project e242403698514922aad5ec97ae17b1c8. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:53:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:53:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-25200043-7050-41dd-a3e1-b79f0e66d7fb tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.987860 Apr 14 05:53:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 149/443] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:53:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:53:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e38b99fb-0f5f-4e45-849d-704e166f0800 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:53:55 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e38b99fb-0f5f-4e45-849d-704e166f0800 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:53:55 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e38b99fb-0f5f-4e45-849d-704e166f0800 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:53:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e38b99fb-0f5f-4e45-849d-704e166f0800 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" status: 200 len: 1212 microversion: 2.1 time: 0.067143 Apr 14 05:53:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 145/444] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:53:55 2023] GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:53:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:53:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:53:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:53:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:53:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] Creating event network-changed:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:53:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-d8363a91-a49f-41b2-a421-69ddcf3864bb req-ab6a9f9f-3951-451d-a9b8-0daffff391b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028687 Apr 14 05:53:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 151/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:53:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:00 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e7d599aa-4485-4dde-b781-ca1cff78a423 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 200 len: 1492 microversion: 2.1 time: 0.180781 Apr 14 05:54:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 150/446] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:00 2023] GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 1492 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:54:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "name": "network-vif-plugged", "status": "completed", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] Creating event network-vif-plugged:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:54:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-66b14b8c-df0c-45f6-b0a7-a550d0f4a985 req-ec887d06-762a-41b9-b5ca-332dcef39f6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Apr 14 05:54:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 146/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] Creating event network-changed:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:54:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c5bb2dc0-fb12-4e7a-8c52-e8ccb0524204 req-530ee474-baa9-48d0-8bf2-2a989fd73a57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030571 Apr 14 05:54:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 152/448] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "name": "network-vif-plugged", "status": "completed", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] Creating event network-vif-plugged:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:54:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-3914e443-9fb4-4462-bc0b-b6de6aae5e38 req-038570bb-84e8-4ff2-9340-f8315b7fa676 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Apr 14 05:54:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 151/449] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:54:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-3e3001de-2324-4c40-8123-4f21d584fa6d req-44baecb3-6f73-429e-882f-e99f1752b41f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082792 Apr 14 05:54:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 147/450] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] [instance: 4a200376-4747-49ed-96d4-3fe9ac338dcc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] HTTP exception thrown: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Request method failure captured: Apr 14 05:54:10 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc HTTP/1.1 Apr 14 05:54:10 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:54:10 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:54:10 user devstack@n-api.service[61644]: Connection: close Apr 14 05:54:10 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:54:10 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:54:10 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:54:10 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:54:10 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOijfM4UvYM-71ktXGvT_gfuq7YLLIHLcbH1m2HCSJEGlVeTLKKCFI-0xxsC8joj-oEXfAh1xiXjeAox9boqjQn1QmhSNLiasryOHDPu0Hco_SXTAZCT1Y85RgWQBN6feWXxY1V7KW8LoGX9XZJi53QkknSwDIIUbwwvmorl6DgfZhU Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Project-Id: 93092d7530694b63aba0a085051c0520 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1786618110 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93092d7530694b63aba0a085051c0520"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/93092d7530694b63aba0a085051c0520"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93092d7530694b63aba0a085051c0520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerStableDeviceRescueTest-1786618110 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Tenant-Id: 93092d7530694b63aba0a085051c0520 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1786618110 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-User: tempest-ServerStableDeviceRescueTest-1786618110-project-member Apr 14 05:54:10 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:54:10 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:54:10 user devstack@n-api.service[61644]: X-User-Id: e733b69143e045bcbe99d823b02aab83 Apr 14 05:54:10 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerStableDeviceRescueTest-1786618110-project-member Apr 14 05:54:10 user devstack@n-api.service[61644]: method: > Apr 14 05:54:10 user devstack@n-api.service[61644]: exception: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. Apr 14 05:54:10 user devstack@n-api.service[61644]: action_args: {'id': '4a200376-4747-49ed-96d4-3fe9ac338dcc'} Apr 14 05:54:10 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. Apr 14 05:54:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:54:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Returning 404 to user: Instance 4a200376-4747-49ed-96d4-3fe9ac338dcc could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:54:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-807f060c-c77f-410e-9ba9-66aa02c32d03 tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc" status: 404 len: 111 microversion: 2.1 time: 0.038536 Apr 14 05:54:10 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 152/451] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:10 2023] GET /compute/v2.1/servers/4a200376-4747-49ed-96d4-3fe9ac338dcc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:54:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d6f9b56f-db52-4b24-9d60-3a84555f8e5f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] Calling method '.version_select at 0x7f55e2e563b0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d6f9b56f-db52-4b24-9d60-3a84555f8e5f tempest-ServerStableDeviceRescueTest-1786618110 tempest-ServerStableDeviceRescueTest-1786618110-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292881497" status: 202 len: 0 microversion: 2.1 time: 0.030763 Apr 14 05:54:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 148/452] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 05:54:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1292881497 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:54:10 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-973d4561-2c0e-4b1c-95f7-54a47ac4de6f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1702 microversion: 2.1 time: 0.233865 Apr 14 05:54:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:10 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1702 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:54:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:54:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-d38c5c86-9ffd-45c9-bd08-94997b36d5de req-37dafd0d-e2ec-4657-98bd-0a277da8aad9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034320 Apr 14 05:54:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 153/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:25 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-af79769a-62d9-423c-9253-c6bda03b611b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1769 microversion: 2.87 time: 0.161018 Apr 14 05:54:25 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 149/455] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:54:25 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1769 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=20 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:30 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:30 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-38c3eb16-ebf5-486c-8511-8f036b955bb7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1539 microversion: 2.1 time: 0.173792 Apr 14 05:54:30 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:30 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c5ab6b9f-2aa2-46ee-aa3e-53d1c0c48280 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 200 len: 1550 microversion: 2.1 time: 0.198689 Apr 14 05:54:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 154/457] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:33 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 1550 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:54:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-40d7bf4d-3f4d-4742-a4e7-ba25d3a5edae tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 204 len: 0 microversion: 2.1 time: 0.167320 Apr 14 05:54:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 150/458] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:54:33 2023] DELETE /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:33 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2fe563ef-9efd-40e0-a1f2-e716d01d554e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 200 len: 1556 microversion: 2.1 time: 0.272624 Apr 14 05:54:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 155/459] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:33 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 1556 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:54:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "name": "network-vif-unplugged", "status": "completed", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] Creating event network-vif-unplugged:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:54:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7a99eb1d-3d73-48fc-b89b-7d2c833f77cf req-84292ce1-ec3c-4514-96b8-941b9f148279 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054197 Apr 14 05:54:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 155/460] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "name": "network-vif-deleted", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] Creating event network-vif-deleted:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:54:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-7677925f-4938-46a7-99ea-d3c54d8c03cd req-a462c30f-97b7-4cd6-a4c2-792ce9687afb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035865 Apr 14 05:54:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 151/461] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2a98a9-3b3c-4e54-924e-47a5c69b1266", "name": "network-vif-plugged", "status": "completed", "tag": "6c275402-2e94-4f9d-86ec-e0c921f8c0cf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:54:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] Creating event network-vif-plugged:6c275402-2e94-4f9d-86ec-e0c921f8c0cf for instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 on user Apr 14 05:54:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-eb662429-1e4a-4c22-a2ad-65ae040016e2 req-a3ee8993-62d2-4753-8940-230229972d1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Apr 14 05:54:36 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 156/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:54:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:44 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:44 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d433d5f6-89e8-49c8-ba6a-db1c511ad94b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1784 microversion: 2.20 time: 0.167355 Apr 14 05:54:44 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 156/463] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:54:44 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1784 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:54:45 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:54:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-35f5e741-8017-4ebc-aec9-ce5c03b8a65b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" status: 200 len: 1494 microversion: 2.1 time: 0.155418 Apr 14 05:54:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 152/464] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:54:45 2023] GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => generated 1494 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=14 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:00 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:55:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2ba62591-3c20-4b3e-8202-dc4ae80e8e9d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 204 len: 0 microversion: 2.1 time: 0.137957 Apr 14 05:55:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 157/465] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:55:00 2023] DELETE /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:00 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-613608f8-98c6-44bf-9674-29e5658a5832 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 200 len: 1498 microversion: 2.1 time: 0.164435 Apr 14 05:55:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 157/466] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:00 2023] GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "name": "network-vif-unplugged", "status": "completed", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] Creating event network-vif-unplugged:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:55:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-4a665519-5352-4018-be7f-ad6882aaaa70 req-46c072d8-23ae-4153-a406-66d2bd0b52de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037705 Apr 14 05:55:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 153/467] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "name": "network-vif-deleted", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] Creating event network-vif-deleted:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:55:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-ce2593a4-8199-487b-8a27-d9640f7fb193 req-a49b1b5f-152b-43d9-97c9-8354a7dc9a5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Apr 14 05:55:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 158/468] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e24f0f-175f-4259-b38d-4fb58ecc508a", "name": "network-vif-plugged", "status": "completed", "tag": "37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] Creating event network-vif-plugged:37e76a28-3f0e-49d7-97c4-be2c6cb1b0a8 for instance b0e24f0f-175f-4259-b38d-4fb58ecc508a on user Apr 14 05:55:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-443962c2-2fff-41d3-b8f9-03f000a75c5e req-c20a2301-7d5d-4286-800d-1d93429fc2eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037391 Apr 14 05:55:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 158/469] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:10 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'services' on Instance uuid 8bc9e54a-dc25-421f-a380-a394b0867000 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:55:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b8314ba0-9c97-495a-8b50-216cf7d15127 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments/e5633694-9b3e-4f90-af91-b14d5be70916" status: 202 len: 0 microversion: 2.1 time: 0.329131 Apr 14 05:55:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 154/470] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:55:10 2023] DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments/e5633694-9b3e-4f90-af91-b14d5be70916 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:13 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Going to try to stop instance {{(pid=61645) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 05:55:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-985aebd7-01b7-4eca-85fc-93fa7422986c tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action" status: 202 len: 0 microversion: 2.1 time: 0.071685 Apr 14 05:55:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 159/471] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:55:13 2023] POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:13 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ee663ff1-ab52-4bed-b5c4-6cfea3068a41 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1666 microversion: 2.1 time: 0.177245 Apr 14 05:55:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 159/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:13 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-unplugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] Creating event network-vif-unplugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:55:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-9b0d5f9c-f9d2-4666-af01-8f9085f790e4 req-28e80eee-827f-4ea9-81a4-584e0cbc6374 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034268 Apr 14 05:55:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 155/473] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:55:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-b3082b0a-9c5a-49e2-b2a4-484648fbc2ff req-ff2f7752-28e9-48bf-a8f7-2e6cf33d15cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Apr 14 05:55:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 160/474] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:55:24 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 HTTP/1.1 Apr 14 05:55:24 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:55:24 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:55:24 user devstack@n-api.service[61644]: Connection: close Apr 14 05:55:24 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:55:24 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:55:24 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:55:24 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:55:24 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:55:24 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:55:24 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:55:24 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:55:24 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:55:24 user devstack@n-api.service[61644]: method: > Apr 14 05:55:24 user devstack@n-api.service[61644]: exception: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:55:24 user devstack@n-api.service[61644]: action_args: {'id': '4b2a98a9-3b3c-4e54-924e-47a5c69b1266'} Apr 14 05:55:24 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:55:24 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:55:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-2f79e963-310b-4805-9802-e7361ce83858 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 404 len: 111 microversion: 2.1 time: 0.037266 Apr 14 05:55:24 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 160/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:24 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "cf95c14b-affd-4386-adf2-cbd9535b19b4"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:25 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'flavor' on Instance uuid 46ae7eba-11e8-4a56-b368-739848ed9dbc {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:55:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f750f840-f55d-47df-a9c5-3e1e25ccc04b tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc/action" status: 200 len: 29 microversion: 2.87 time: 0.547296 Apr 14 05:55:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 156/476] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:55:25 2023] POST /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc/action => generated 29 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:26 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:26 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a891bbc3-c1a8-43c8-bd4c-02e28fff428e tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1775 microversion: 2.87 time: 0.231848 Apr 14 05:55:26 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 161/477] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:55:26 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1775 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:55:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-unplugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] Creating event network-vif-unplugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:55:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-dfdfa6e1-3d00-496b-b118-70b770e4c720 req-b7d1f7e7-6bd8-425a-84f6-dc752840592b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037288 Apr 14 05:55:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 161/478] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:27 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:55:27 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b2c5d6ee-4ab7-404a-875d-9a07db3a9da3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 204 len: 0 microversion: 2.1 time: 0.126597 Apr 14 05:55:27 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 157/479] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:55:27 2023] DELETE /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:27 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a873eaef-2022-4b5c-8ac3-cb4e8014a99a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 200 len: 1400 microversion: 2.1 time: 0.208121 Apr 14 05:55:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 162/480] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:27 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 1400 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:29 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}, {"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}, {"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}, {"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Creating event network-vif-unplugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-fe05bb09-c7d5-48c3-93bc-ff989e558325 req-3519ead2-04bd-4936-9e22-fb43b8f368f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.045743 Apr 14 05:55:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 162/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-deleted", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] Creating event network-vif-deleted:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-4fe5e5f8-cf81-45b6-8026-bab4cebac105 req-cac80ace-9979-4e5a-b413-aa7155b635d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033997 Apr 14 05:55:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 158/482] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:30 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-64fa8c28-1e3b-4071-86e2-1b67028efd6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.141274 Apr 14 05:55:30 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 163/483] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 05:55:30 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-interface => generated 282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}, {"server_uuid": "bf721faf-a8f3-42d6-a980-a49232e383d4", "name": "network-vif-plugged", "status": "completed", "tag": "f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Creating event network-vif-unplugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] Creating event network-vif-plugged:f4bd1b88-043a-42bc-9ae9-b4fcbde98bd6 for instance bf721faf-a8f3-42d6-a980-a49232e383d4 on user Apr 14 05:55:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b5140ea7-408a-42b9-9677-499db4c46490 req-19f9ca0c-18a1-4f27-b46b-3edbd6f8680c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042837 Apr 14 05:55:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 163/484] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] Creating event network-changed:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:55:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ed835d91-0071-471a-9ce5-199f22f235b5 req-527231a9-010a-42e7-a1ea-44535bdd2488 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041997 Apr 14 05:55:31 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 159/485] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-03649aba-3ba5-4cdf-b275-a1e19eb2d767 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1539 microversion: 2.1 time: 0.216688 Apr 14 05:55:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 164/486] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:31 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:31 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c7f00fa3-f8ae-4fbb-beae-8cd4e0144277 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1539 microversion: 2.1 time: 0.333052 Apr 14 05:55:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 164/487] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:31 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1539 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:55:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:55:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:55:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-d3d3dffd-53e3-4e14-9e87-cf44b4f480a6 req-15b1cc31-c9fc-4b7f-b4d1-617109d03f64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056371 Apr 14 05:55:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 160/488] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:55:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=22 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5d18e1be-f571-4025-aa93-ca3d3bb5c96b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments/c444d6ac-de53-4cae-b3d6-7365fbc7c282" status: 200 len: 194 microversion: 2.20 time: 0.229295 Apr 14 05:55:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 165/489] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 05:55:44 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments/c444d6ac-de53-4cae-b3d6-7365fbc7c282 => generated 194 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=14 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'services' on Instance uuid 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:55:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-fbd3db50-c21e-4f29-a624-ecfd10605df5 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments/c444d6ac-de53-4cae-b3d6-7365fbc7c282" status: 202 len: 0 microversion: 2.20 time: 0.316907 Apr 14 05:55:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 165/490] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 05:55:45 2023] DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments/c444d6ac-de53-4cae-b3d6-7365fbc7c282 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3b34e7aa-b638-4804-831e-231d4a596adf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064317 Apr 14 05:55:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 161/491] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 05:55:45 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da702a2-7d93-4521-a579-acc98f437f9b", "device": "/dev/vdb"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:46 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-1ef6b9ca-d57b-48ec-bb4b-c2e0204d7f76 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499450 Apr 14 05:55:46 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 166/492] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:55:46 2023] POST /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/os-volume_attachments => generated 194 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] HTTP exception thrown: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 05:55:50 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a HTTP/1.1 Apr 14 05:55:50 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:55:50 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:55:50 user devstack@n-api.service[61644]: Connection: close Apr 14 05:55:50 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:55:50 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:55:50 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:55:50 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:55:50 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:55:50 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:55:50 user devstack@n-api.service[61644]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:55:50 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:55:50 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:55:50 user devstack@n-api.service[61644]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 05:55:50 user devstack@n-api.service[61644]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:55:50 user devstack@n-api.service[61644]: method: > Apr 14 05:55:50 user devstack@n-api.service[61644]: exception: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 05:55:50 user devstack@n-api.service[61644]: action_args: {'id': 'b0e24f0f-175f-4259-b38d-4fb58ecc508a'} Apr 14 05:55:50 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 05:55:50 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:55:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 404 to user: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:55:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4eb70890-d76a-4146-9a23-51c077869259 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 404 len: 111 microversion: 2.1 time: 0.044611 Apr 14 05:55:50 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 166/493] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:50 2023] GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:55:50 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:55:50 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-55ab2ecf-4763-4e4b-8585-6990aa9e90d4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1493 microversion: 2.1 time: 0.162685 Apr 14 05:55:50 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 162/494] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:55:50 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1493 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:03 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3cca9f41-99ed-4a1a-95cb-7a47b15ffe20 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1643 microversion: 2.1 time: 0.342851 Apr 14 05:56:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 167/495] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:03 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1643 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lazy-loading 'services' on Instance uuid f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:56:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-fc638b7b-27d7-4c92-842d-455b7e128137 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/os-volume_attachments/9da702a2-7d93-4521-a579-acc98f437f9b" status: 202 len: 0 microversion: 2.1 time: 0.390454 Apr 14 05:56:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 167/496] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:56:09 2023] DELETE /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed/os-volume_attachments/9da702a2-7d93-4521-a579-acc98f437f9b => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:56:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a5311847-b1ec-4c7d-90f7-1ff1c456395b tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" status: 204 len: 0 microversion: 2.1 time: 0.120841 Apr 14 05:56:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 163/497] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:56:09 2023] DELETE /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92aac6d019db4be3bfe3016653ccc7a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e242403698514922aad5ec97ae17b1c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6f927e9e-344c-4e32-9264-720c8bd4ec57 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" status: 200 len: 1546 microversion: 2.1 time: 0.151690 Apr 14 05:56:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 168/498] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:09 2023] GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "name": "network-vif-unplugged", "status": "completed", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] Creating event network-vif-unplugged:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:56:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-0137c130-73d6-4329-b298-43a6963c8624 req-511c9840-6641-4228-acb1-f15b64a60247 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052939 Apr 14 05:56:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 168/499] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "name": "network-vif-deleted", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] Creating event network-vif-deleted:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:56:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-086c4f3a-7535-4bb5-84d7-c2b15fb4cbd1 req-5f6c554e-3d09-4e01-9321-462e6e25d544 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034450 Apr 14 05:56:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 164/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed", "name": "network-vif-plugged", "status": "completed", "tag": "faffd2ae-2e8b-4a66-8121-dfc574aeb634"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] Creating event network-vif-plugged:faffd2ae-2e8b-4a66-8121-dfc574aeb634 for instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed on user Apr 14 05:56:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-57404739-d151-4f84-a587-9048fcbc91ae req-61726a77-e67a-491b-9f44-957488915a25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031725 Apr 14 05:56:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 169/501] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7df92186-f586-4cf8-98a2-b2262e9cd727 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1755 microversion: 2.87 time: 0.401577 Apr 14 05:56:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 169/502] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:56:16 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1755 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:56:17 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 HTTP/1.1 Apr 14 05:56:17 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:56:17 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:56:17 user devstack@n-api.service[61646]: Connection: close Apr 14 05:56:17 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:56:17 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:56:17 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:56:17 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:56:17 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61646]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:56:17 user devstack@n-api.service[61646]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61646]: method: > Apr 14 05:56:17 user devstack@n-api.service[61646]: exception: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61646]: action_args: {'id': 'bf721faf-a8f3-42d6-a980-a49232e383d4'} Apr 14 05:56:17 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-1d4e86d8-6346-4af8-bf6a-488b6ff1b83c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 404 len: 111 microversion: 2.1 time: 0.027669 Apr 14 05:56:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 165/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:17 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:56:17 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 HTTP/1.1 Apr 14 05:56:17 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:56:17 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:56:17 user devstack@n-api.service[61645]: Connection: close Apr 14 05:56:17 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:56:17 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:56:17 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:56:17 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:56:17 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61645]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:56:17 user devstack@n-api.service[61645]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61645]: method: > Apr 14 05:56:17 user devstack@n-api.service[61645]: exception: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61645]: action_args: {'id': '4b2a98a9-3b3c-4e54-924e-47a5c69b1266'} Apr 14 05:56:17 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2ac42e35-edd1-4e18-b4db-f2379077fc63 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 404 len: 111 microversion: 2.1 time: 0.036741 Apr 14 05:56:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 170/504] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:56:17 2023] DELETE /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 4b2a98a9-3b3c-4e54-924e-47a5c69b1266] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:56:17 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 HTTP/1.1 Apr 14 05:56:17 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:56:17 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:56:17 user devstack@n-api.service[61644]: Connection: close Apr 14 05:56:17 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:56:17 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:56:17 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:56:17 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:56:17 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:56:17 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:56:17 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:56:17 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:17 user devstack@n-api.service[61644]: method: > Apr 14 05:56:17 user devstack@n-api.service[61644]: exception: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61644]: action_args: {'id': '4b2a98a9-3b3c-4e54-924e-47a5c69b1266'} Apr 14 05:56:17 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. Apr 14 05:56:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 4b2a98a9-3b3c-4e54-924e-47a5c69b1266 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1e22ac11-de8b-4596-830d-8c332fa68125 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266" status: 404 len: 111 microversion: 2.1 time: 0.031883 Apr 14 05:56:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 170/505] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:17 2023] GET /compute/v2.1/servers/4b2a98a9-3b3c-4e54-924e-47a5c69b1266 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:56:18 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 HTTP/1.1 Apr 14 05:56:18 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:56:18 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:56:18 user devstack@n-api.service[61646]: Connection: close Apr 14 05:56:18 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 05:56:18 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:56:18 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:56:18 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:56:18 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:18 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:56:18 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:56:18 user devstack@n-api.service[61646]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:56:18 user devstack@n-api.service[61646]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:18 user devstack@n-api.service[61646]: method: > Apr 14 05:56:18 user devstack@n-api.service[61646]: exception: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61646]: action_args: {'id': 'bf721faf-a8f3-42d6-a980-a49232e383d4'} Apr 14 05:56:18 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a591c026-861c-4b38-b9e7-477bf07aef2d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 404 len: 111 microversion: 2.1 time: 0.033248 Apr 14 05:56:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 166/506] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:56:17 2023] DELETE /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: bf721faf-a8f3-42d6-a980-a49232e383d4] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:56:18 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 HTTP/1.1 Apr 14 05:56:18 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:56:18 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:56:18 user devstack@n-api.service[61645]: Connection: close Apr 14 05:56:18 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:56:18 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:56:18 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:56:18 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:56:18 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:18 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:56:18 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:56:18 user devstack@n-api.service[61645]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:56:18 user devstack@n-api.service[61645]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:56:18 user devstack@n-api.service[61645]: method: > Apr 14 05:56:18 user devstack@n-api.service[61645]: exception: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61645]: action_args: {'id': 'bf721faf-a8f3-42d6-a980-a49232e383d4'} Apr 14 05:56:18 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. Apr 14 05:56:18 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:56:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance bf721faf-a8f3-42d6-a980-a49232e383d4 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-1924a58b-1f55-4214-9d89-9d7b64a5cf92 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4" status: 404 len: 111 microversion: 2.1 time: 0.031383 Apr 14 05:56:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 171/507] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:18 2023] GET /compute/v2.1/servers/bf721faf-a8f3-42d6-a980-a49232e383d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:56:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f2258387-6591-4ddf-95e9-532f545b839b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: .version_select at 0x7f55e2931480>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2009419178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi0gmlwnIuGkACMZnp9pkEYQ9cNzO7jxfnmqN5/sZ38O6IJUKZ/O1AhdtbSzS/JRhnKL0F4iTmQEzxie1D8zsy6I0wdF1TDMhD3yKmR8IvTs8BuAAtn+kWswzOAvTJYew=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:18 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-f2258387-6591-4ddf-95e9-532f545b839b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:56:18 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-f2258387-6591-4ddf-95e9-532f545b839b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:56:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f2258387-6591-4ddf-95e9-532f545b839b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051712 Apr 14 05:56:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 171/508] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:56:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:22 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a89ea4b7-3730-4197-9cb9-03e5fe5aac5a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1657 microversion: 2.1 time: 0.381024 Apr 14 05:56:22 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 167/509] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:22 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1657 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:22 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6a57a3e6-71c8-42df-833e-055b64aea9a0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1657 microversion: 2.1 time: 0.152043 Apr 14 05:56:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 172/510] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:22 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1162542981", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2009419178", "security_groups": [{"name": "tempest-secgroup-smoke-1262837136"}], "block_device_mapping_v2": [{"uuid": "74dc3ebd-bb57-4a6a-be70-a383598ad5ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:56:23 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:56:24 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:56:24 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74dc3ebd-bb57-4a6a-be70-a383598ad5ff',volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:56:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-aaef3b57-55e7-47fc-9bbb-ed76044fc400 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.680192 Apr 14 05:56:24 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 172/511] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:56:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:56:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c97e1db8-53e7-42ee-a350-149bb06b32b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:24 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-c97e1db8-53e7-42ee-a350-149bb06b32b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:24 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-c97e1db8-53e7-42ee-a350-149bb06b32b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c97e1db8-53e7-42ee-a350-149bb06b32b5 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 200 len: 1090 microversion: 2.1 time: 0.065468 Apr 14 05:56:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 168/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:24 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 1090 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] Creating event network-changed:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:56:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-849e3fd0-13e7-4e9e-bdc3-c35edeb0bab6 req-465aefca-a96a-48b1-b379-65bb0fd6daa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087268 Apr 14 05:56:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 173/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "name": "network-vif-plugged", "status": "completed", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] Creating event network-vif-plugged:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:56:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-457f7ad4-d7ed-4187-b45b-8f8db2a7f2f4 req-d76fe420-a913-465b-a918-9a15d0c744f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043112 Apr 14 05:56:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 173/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "name": "network-vif-plugged", "status": "completed", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] Creating event network-vif-plugged:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:56:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-64e073d5-f24b-4940-902f-78cfadd6c0b1 req-2881415a-9267-4bab-953f-b6dd5ed4caa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050150 Apr 14 05:56:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 169/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=27 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4ee9ec77-c999-4cf3-ba52-9e974697ae10 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053223 Apr 14 05:56:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 174/516] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 05:56:35 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:56:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-640299ea-7765-449b-99b0-694f23d48c8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 204 len: 0 microversion: 2.20 time: 0.128312 Apr 14 05:56:35 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 174/517] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 05:56:35 2023] DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:36 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:36 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:36 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:36 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a65fd06a-8539-45df-b40d-3df5ce1992ed tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 200 len: 1712 microversion: 2.20 time: 0.198249 Apr 14 05:56:36 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 170/518] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:56:35 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 1712 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:56:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}, {"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-plugged", "status": "completed", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Creating event network-vif-unplugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:56:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] Creating event network-vif-plugged:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:56:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-fde5ba08-6e08-4b67-8865-2fbd8f0307b8 req-2792ce44-09b3-4687-99cd-457747c50fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037596 Apr 14 05:56:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 175/519] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87153a66-bf2c-45f5-aa66-c94eaa6ea7ea", "name": "network-vif-deleted", "tag": "2d2429bd-952a-41bd-8807-48328561c775"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] Creating event network-vif-deleted:2d2429bd-952a-41bd-8807-48328561c775 for instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea on user Apr 14 05:56:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e3c5e734-233a-4d15-a750-ca3d1819ede4 req-329c7bb7-84f7-4e6f-953e-dcdec0b98401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Apr 14 05:56:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 175/520] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:56:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:56:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3cb36308-2c4e-41a3-9c83-6eab5aa7a831 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-236614792", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ae84f3f9-9076-4962-b330-986d684a77cd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:56:53 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:53 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-3cb36308-2c4e-41a3-9c83-6eab5aa7a831 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] HTTP exception thrown: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. Apr 14 05:56:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3cb36308-2c4e-41a3-9c83-6eab5aa7a831 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 05:56:53 user devstack@n-api.service[61646]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 05:56:53 user devstack@n-api.service[61646]: Accept: application/json Apr 14 05:56:53 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 05:56:53 user devstack@n-api.service[61646]: Connection: close Apr 14 05:56:53 user devstack@n-api.service[61646]: Content-Length: 356 Apr 14 05:56:53 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 05:56:53 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 05:56:53 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 05:56:53 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:56:53 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:56:53 user devstack@n-api.service[61646]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:56:53 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 05:56:53 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 05:56:53 user devstack@n-api.service[61646]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 05:56:53 user devstack@n-api.service[61646]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:56:53 user devstack@n-api.service[61646]: Apr 14 05:56:53 user devstack@n-api.service[61646]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-236614792", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ae84f3f9-9076-4962-b330-986d684a77cd", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} Apr 14 05:56:53 user devstack@n-api.service[61646]: method: > Apr 14 05:56:53 user devstack@n-api.service[61646]: exception: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. Apr 14 05:56:53 user devstack@n-api.service[61646]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-236614792', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ae84f3f9-9076-4962-b330-986d684a77cd'}], 'networks': [{'uuid': '0af82dbe-8b33-44ba-9d0a-3653b2dcc439'}]}}} Apr 14 05:56:53 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. Apr 14 05:56:53 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 05:56:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3cb36308-2c4e-41a3-9c83-6eab5aa7a831 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 400 to user: Block Device ae84f3f9-9076-4962-b330-986d684a77cd is not bootable. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3cb36308-2c4e-41a3-9c83-6eab5aa7a831 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.071483 Apr 14 05:56:53 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 171/521] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:56:53 2023] POST /compute/v2.1/servers => generated 110 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=7 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:53 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:56:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-94b7979b-b676-46dd-aff8-093a9b10a54d tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1493 microversion: 2.1 time: 0.156191 Apr 14 05:56:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 176/522] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:53 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] [instance: f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:56:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] HTTP exception thrown: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Request method failure captured: Apr 14 05:56:59 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed HTTP/1.1 Apr 14 05:56:59 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:56:59 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:56:59 user devstack@n-api.service[61644]: Connection: close Apr 14 05:56:59 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:56:59 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:56:59 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:56:59 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:56:59 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmgCTo1MdVje8ZupQVyuOKm2UV2Cbj_Z8BoKuvQ4itKuv1eG7YYSniVQUbirCTC_Uwn3P_oikzIJtD19820p0UWmJOupqUmqsaXmdPFNs80ONmeREyFNaY3zhJJCL8byfhZts6eIBeFMoVn0_FxCFaXi0qzG7WSsXAKqBdBgiTW-wc Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Project-Id: e242403698514922aad5ec97ae17b1c8 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e242403698514922aad5ec97ae17b1c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Tenant-Id: e242403698514922aad5ec97ae17b1c8 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-186190223 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-User: tempest-VolumesSnapshotTestJSON-186190223-project-member Apr 14 05:56:59 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:56:59 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:56:59 user devstack@n-api.service[61644]: X-User-Id: 92aac6d019db4be3bfe3016653ccc7a0 Apr 14 05:56:59 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesSnapshotTestJSON-186190223-project-member Apr 14 05:56:59 user devstack@n-api.service[61644]: method: > Apr 14 05:56:59 user devstack@n-api.service[61644]: exception: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. Apr 14 05:56:59 user devstack@n-api.service[61644]: action_args: {'id': 'f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed'} Apr 14 05:56:59 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. Apr 14 05:56:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:56:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] Returning 404 to user: Instance f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:56:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4fc4d7aa-1ad0-4bdb-9f9e-c5b6642a9252 tempest-VolumesSnapshotTestJSON-186190223 tempest-VolumesSnapshotTestJSON-186190223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed" status: 404 len: 111 microversion: 2.1 time: 0.033556 Apr 14 05:56:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 176/523] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:56:59 2023] GET /compute/v2.1/servers/f2d98445-05d5-4dd0-a9aa-3cfbca6b71ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:57:03 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:04 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Going to try to start instance {{(pid=61646) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 05:57:04 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8cdbb0cf-bdcb-418a-b803-ff3c461ffb0a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action" status: 202 len: 0 microversion: 2.1 time: 0.104507 Apr 14 05:57:04 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 172/524] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 05:57:03 2023] POST /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:04 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-781e3da4-7941-40a0-ac99-547419ba90aa tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1652 microversion: 2.1 time: 0.236795 Apr 14 05:57:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 177/525] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:04 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1652 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-67a9136b-1346-4846-8024-80cf7dba13f1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'create', calling method: .version_select at 0x7f55e2932c20>, body: {"keypair": {"name": "tempest-TestStampPattern-1286641636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcG2b0c5lB1OTtRptiZOYLsv66c2YAO6Emth1PUn8sXGE4GHBGxeL8wBPcM1Lm0S0rTUfPzymAH0yKo7CcszDhOuQKdNtWzOBHBlEzaLALbxv6+KJBJZLkYLwUsiabyhg=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:57:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-4447e98c-94c6-4268-b8b8-3c351b35a449 req-c8e71a28-7741-470d-a99c-6abef5a0e00e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203611 Apr 14 05:57:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 173/526] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:57:07 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-67a9136b-1346-4846-8024-80cf7dba13f1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:57:07 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-67a9136b-1346-4846-8024-80cf7dba13f1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for user 80e1861ede2547f1b3051829eaef8b7b and project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:57:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-67a9136b-1346-4846-8024-80cf7dba13f1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.472359 Apr 14 05:57:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 177/527] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:57:07 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:57:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-6b503735-0e14-4c26-9470-7f95ff45cbc6 req-dbe6b71c-d587-46d0-856e-d3d7385b5974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Apr 14 05:57:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 178/528] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1652264087", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1286641636", "security_groups": [{"name": "tempest-secgroup-smoke-807094077"}], "networks": [{"uuid": "854353ae-dcf2-46cd-8b84-8d47764d065c"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:11 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] validate_networks() for [('854353ae-dcf2-46cd-8b84-8d47764d065c', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for user 80e1861ede2547f1b3051829eaef8b7b and project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:57:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:57:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-69692a53-e291-4d2e-9325-bac6c393e428 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.047123 Apr 14 05:57:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 174/529] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:57:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:57:12 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d0adcf65-c12e-48b8-afee-5f496f6fb6a2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d0adcf65-c12e-48b8-afee-5f496f6fb6a2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:12 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d0adcf65-c12e-48b8-afee-5f496f6fb6a2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d0adcf65-c12e-48b8-afee-5f496f6fb6a2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 200 len: 1237 microversion: 2.1 time: 0.103065 Apr 14 05:57:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 178/530] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:12 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 1237 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:14 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-058ec289-038c-4df7-a9bf-e41a5232192b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 200 len: 1443 microversion: 2.1 time: 0.168398 Apr 14 05:57:14 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 179/531] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:14 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:15 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] Creating event network-changed:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 05:57:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b84d9ce9-3119-4e8b-802a-125a645148e8 req-ca624fe9-bcc9-4ffc-b423-f769867b03b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Apr 14 05:57:15 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 175/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9544bd3a-175a-4422-b32c-ecfaaeeab961 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc/action" status: 202 len: 0 microversion: 2.87 time: 0.079681 Apr 14 05:57:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 179/533] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:57:16 2023] POST /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4b528828-de9b-4e53-8389-38733bc9e130 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1763 microversion: 2.87 time: 0.191453 Apr 14 05:57:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 180/534] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:57:16 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1763 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:57:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "name": "network-vif-plugged", "status": "completed", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] Creating event network-vif-plugged:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 05:57:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-657c2799-dee0-4646-9c54-7a6e9c67264f req-a4013fb5-56cc-4e7b-a496-81ce72acacaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051520 Apr 14 05:57:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 176/535] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-unplugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] Creating event network-vif-unplugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-4481b8a7-25cc-4f77-a85c-6a9d3ae41f66 req-2e68eac7-c39a-4fb1-81d0-1fd221bb31a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051171 Apr 14 05:57:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 180/536] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 05:57:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "name": "network-vif-plugged", "status": "completed", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] Creating event network-vif-plugged:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 05:57:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-cebeec55-7765-4ad9-a60e-1e27561ab5f1 req-17176a87-7ed4-4b53-804d-9e03d7304025 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054842 Apr 14 05:57:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 181/537] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:20 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-unplugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Creating event network-vif-unplugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-99af6b93-e9d0-49c5-8713-051d1d28343f req-14ebfcb1-e8c9-44e6-b832-42bbe2d02c94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.043775 Apr 14 05:57:20 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 177/538] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}, {"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 05:57:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-aa2b027a-00ad-431d-a691-d33faf7a1fa7 req-0644856a-b620-4e63-8670-a00ceca346f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098183 Apr 14 05:57:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 181/539] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:25 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4a9ec9b2-b736-4cca-b336-60ce61a675e0 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1657 microversion: 2.1 time: 0.166970 Apr 14 05:57:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 182/540] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:25 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1657 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e6273786-cd8c-484d-96ef-5d261ae12f5b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366044 Apr 14 05:57:25 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 178/541] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:57:25 2023] POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 05:57:26 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea HTTP/1.1 Apr 14 05:57:26 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:57:26 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:57:26 user devstack@n-api.service[61644]: Connection: close Apr 14 05:57:26 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:57:26 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:57:26 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:57:26 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:57:26 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 05:57:26 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 05:57:26 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 05:57:26 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:57:26 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:57:26 user devstack@n-api.service[61644]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 05:57:26 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 05:57:26 user devstack@n-api.service[61644]: method: > Apr 14 05:57:26 user devstack@n-api.service[61644]: exception: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 05:57:26 user devstack@n-api.service[61644]: action_args: {'id': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea'} Apr 14 05:57:26 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 05:57:26 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:57:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:57:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-bf965e9f-fb65-4dc0-89f1-d868d44bc489 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 404 len: 111 microversion: 2.20 time: 0.046088 Apr 14 05:57:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 182/542] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:57:26 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:57:26 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b9b99aef-e08f-405b-b5ae-d65fefc4bcbb tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '.version_select at 0x7f55e29ccd30>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:26 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b9b99aef-e08f-405b-b5ae-d65fefc4bcbb tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417329181" status: 204 len: 0 microversion: 2.20 time: 0.032622 Apr 14 05:57:26 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 183/543] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 05:57:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417329181 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 05:57:27 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a7ccf3d8-81b3-44cb-a623-60feeb87ac12 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: .version_select at 0x7f55e2bf76d0>, body: {"keypair": {"name": "tempest-keypair-281561404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj45WaFx8qIhjQPabhfxsWHA1PKIKKwtfrQJR3MqBpiqoCGN6x1pQ48FY1HRxszOWvQ149S+9eT9WsV7wUAXKXME2zAw5wX99IzrhcOJC2qmHxSZPdB5oJ1T5winHfSMw=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:27 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a7ccf3d8-81b3-44cb-a623-60feeb87ac12 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for project a335a6c17041473ca2abf256cb30a25f. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:57:27 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a7ccf3d8-81b3-44cb-a623-60feeb87ac12 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for user e7fece08f6f649bb89fc8ae5121bc2cc and project a335a6c17041473ca2abf256cb30a25f. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:57:27 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a7ccf3d8-81b3-44cb-a623-60feeb87ac12 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052741 Apr 14 05:57:27 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 179/544] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 05:57:27 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 05:57:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1479627857", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "77dc8e6f-e239-4937-ad9a-eb68543f6e86"}], "security_groups": [{"name": "tempest-securitygroup--487963200"}], "key_name": "tempest-keypair-281561404", "user_data": "}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:28 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] validate_networks() for [('77dc8e6f-e239-4937-ad9a-eb68543f6e86', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for project a335a6c17041473ca2abf256cb30a25f. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Getting quotas for user e7fece08f6f649bb89fc8ae5121bc2cc and project a335a6c17041473ca2abf256cb30a25f. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:57:29 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:57:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ffcb11a2-d5a6-4624-a9eb-76fc502b4526 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.605138 Apr 14 05:57:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 183/545] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:57:28 2023] POST /compute/v2.1/servers => generated 399 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:57:29 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:29 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:29 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:29 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:29 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:29 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-da7b0c92-20ce-4af6-adeb-332f4611c554 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1275 microversion: 2.20 time: 0.090819 Apr 14 05:57:29 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 184/546] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:57:29 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1275 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:57:32 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:32 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:32 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] Creating event network-changed:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:57:32 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-eb5d2199-f1c5-47b3-9268-925550fc058a req-d35c0262-fd73-4b26-876f-cad6ad0c9bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030669 Apr 14 05:57:32 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 180/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:33 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-bd74690d-4a75-46dd-9141-b5eee5949f8b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1703 microversion: 2.1 time: 0.215732 Apr 14 05:57:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 184/548] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:33 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1703 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1862725483", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: dict_keys(['metadata_items']) {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: dict_keys(['metadata_items']) {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:34 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a3d6ea07-5b0f-471d-9b48-dd34f830bdf9 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action" status: 202 len: 1159 microversion: 2.1 time: 0.474056 Apr 14 05:57:34 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 185/549] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 05:57:33 2023] POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action => generated 1159 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:34 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f5ba68b3-56bc-4d97-8247-cb4e5a5f6a66 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1732 microversion: 2.1 time: 0.274493 Apr 14 05:57:34 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 181/550] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:34 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-unplugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:34 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] Creating event network-vif-unplugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:57:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ed976872-bd19-4eac-9e44-79d7c73633bf req-cd2a8c9f-a0d6-481f-8f42-0091cdd30f4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051172 Apr 14 05:57:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 185/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:36 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:57:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:57:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:57:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-889bb039-1619-4b93-bd3f-623d66e6ae70 req-ea066c29-3b48-468f-b010-87a8596084ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.064306 Apr 14 05:57:36 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 186/552] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:36 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=5 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:57:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-6faf378a-9048-498e-b46d-acbccaa06613 req-0053257b-0f56-45d3-bdf4-774e549a3851 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065113 Apr 14 05:57:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 182/553] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 05:57:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-8be02a66-ea51-4845-b517-6666282c62f6 req-f9ebcd26-7f20-430e-89a4-1ac74de18a00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071604 Apr 14 05:57:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 186/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:54 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f03d8384-bd61-4528-a5c8-5435750d1dc8 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1493 microversion: 2.1 time: 0.176749 Apr 14 05:57:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 187/555] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:54 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1493 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:57:54 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:57:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-19c3dc32-4a11-4cde-b2d0-13a095896429 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1656 microversion: 2.1 time: 0.151953 Apr 14 05:57:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 183/556] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:57:54 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:03 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-82af09d2-9c99-4452-b8d4-b6c55f067953 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 200 len: 1538 microversion: 2.1 time: 0.165471 Apr 14 05:58:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 187/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:02 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 1538 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4a6b8803-b0ba-4572-9bf3-d9108fdf71df tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1769 microversion: 2.87 time: 0.174616 Apr 14 05:58:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 188/558] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:58:07 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1769 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:14 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5647554a-5952-44e1-b4c0-a4bf0f6e7c1f tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 200 len: 1443 microversion: 2.1 time: 0.462291 Apr 14 05:58:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 184/559] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:14 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 1443 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] Creating event network-changed:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:58:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-1da9d2f0-0ac1-4630-8c87-c4b469b48fd7 req-2f136d79-05e4-4e24-bc36-780011c542c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092461 Apr 14 05:58:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 188/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:58:16 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-345f2d03-1c7f-4cbf-b8f7-d7a4cd241fc3 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 204 len: 0 microversion: 2.1 time: 0.123522 Apr 14 05:58:16 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 189/561] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:58:16 2023] DELETE /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:17 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5c81f676-eedd-48f2-8fd3-9f6b218058b4 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 200 len: 1449 microversion: 2.1 time: 0.181843 Apr 14 05:58:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 185/562] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:16 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 1449 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] Creating event network-vif-unplugged:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:58:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-17a98926-6d19-49fd-9eab-ffc4ebb84835 req-9012ca41-95f2-4039-a0f4-e058ddd0e853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033025 Apr 14 05:58:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 189/563] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:58:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "name": "network-vif-deleted", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] Creating event network-vif-deleted:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:58:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-de8bcbbe-a835-49fb-9080-ba61d2d81dde req-183fdbd1-854f-4dc3-8830-c91f6f9f385e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055655 Apr 14 05:58:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 190/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:58:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4a6a71-954f-4f37-8210-aa86e84828f8", "name": "network-vif-plugged", "status": "completed", "tag": "2e7c7b93-c896-4047-9b97-306ffada8fe1"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] Creating event network-vif-plugged:2e7c7b93-c896-4047-9b97-306ffada8fe1 for instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 on user Apr 14 05:58:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-cf17c00e-85ed-4d1f-91f9-4f7d9ab47626 req-0e05b69f-ea6f-4003-ad5f-c4e9abaaf407 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Apr 14 05:58:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 186/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:19 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-2e3ae465-b791-4309-8d13-ddfd7e3f00b1 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1587 microversion: 2.20 time: 0.158914 Apr 14 05:58:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 190/566] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:58:19 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1587 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:24 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6216ad9f-ee01-4b84-9412-cb7c16676d85 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.144477 Apr 14 05:58:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 191/567] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:24 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=14 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5aca4b19-bbcb-4328-8484-90bc7d6cba91 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049541 Apr 14 05:58:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 187/568] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:58:54 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:54 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 05:58:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8cf7be32-1d01-49a6-ae08-84817438e5de tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 204 len: 0 microversion: 2.1 time: 0.135476 Apr 14 05:58:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 191/569] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 05:58:54 2023] DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:55 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-unplugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-524f730b-5f3c-4550-87c1-108225142e88 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 200 len: 1662 microversion: 2.1 time: 0.245539 Apr 14 05:58:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 192/570] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:55 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 1662 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] Creating event network-vif-unplugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:58:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-724ed84e-94a2-4163-9e50-a26fa8c58e48 req-477036eb-5902-43b9-b0fe-52addbeaff62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038500 Apr 14 05:58:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 188/571] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:58:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6ffa5d81-d7ad-474b-a36e-876410cfd1cb tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599745604", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "destination_type": "local"}, {"source_type": "volume", "uuid": "d9de32fa-a2f2-409e-b9b6-e589e6021514", "destination_type": "invalid"}], "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6ffa5d81-d7ad-474b-a36e-876410cfd1cb tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 05:58:56 user devstack@n-api.service[61644]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 05:58:56 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:58:56 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:58:56 user devstack@n-api.service[61644]: Connection: close Apr 14 05:58:56 user devstack@n-api.service[61644]: Content-Length: 493 Apr 14 05:58:56 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:58:56 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:58:56 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:58:56 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 05:58:56 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 05:58:56 user devstack@n-api.service[61644]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:58:56 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:58:56 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:58:56 user devstack@n-api.service[61644]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 05:58:56 user devstack@n-api.service[61644]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 05:58:56 user devstack@n-api.service[61644]: Apr 14 05:58:56 user devstack@n-api.service[61644]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-599745604", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "destination_type": "local"}, {"source_type": "volume", "uuid": "d9de32fa-a2f2-409e-b9b6-e589e6021514", "destination_type": "invalid"}], "networks": [{"uuid": "0af82dbe-8b33-44ba-9d0a-3653b2dcc439"}]}} Apr 14 05:58:56 user devstack@n-api.service[61644]: method: > Apr 14 05:58:56 user devstack@n-api.service[61644]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 05:58:56 user devstack@n-api.service[61644]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-599745604', 'imageRef': '3644c9ad-79f4-4051-9ff8-56e591db88fa', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '3644c9ad-79f4-4051-9ff8-56e591db88fa', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd9de32fa-a2f2-409e-b9b6-e589e6021514', 'destination_type': 'invalid'}], 'networks': [{'uuid': '0af82dbe-8b33-44ba-9d0a-3653b2dcc439'}]}}} Apr 14 05:58:56 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise error Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 05:58:56 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:58:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6ffa5d81-d7ad-474b-a36e-876410cfd1cb tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:58:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-6ffa5d81-d7ad-474b-a36e-876410cfd1cb tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011146 Apr 14 05:58:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 192/572] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:58:56 2023] POST /compute/v2.1/servers => generated 155 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:57 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:58:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-17089d81-27c7-4c4f-b722-bea4390823ed tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1493 microversion: 2.1 time: 0.200614 Apr 14 05:58:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 193/573] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:58:56 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1493 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:58:57 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-plugged", "status": "completed", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}, {"server_uuid": "8bc9e54a-dc25-421f-a380-a394b0867000", "name": "network-vif-deleted", "tag": "afbb14f2-3ce8-4993-b4cb-40e2c9567067"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:58:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:58:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:58:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:58:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Creating event network-vif-plugged:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:58:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] Creating event network-vif-deleted:afbb14f2-3ce8-4993-b4cb-40e2c9567067 for instance 8bc9e54a-dc25-421f-a380-a394b0867000 on user Apr 14 05:58:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-88d674b9-61ee-4a37-9ce1-65679fcbca5b req-7be39e0b-cf5e-4a9c-95d0-ff938f4da023 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033490 Apr 14 05:58:57 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 189/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:58:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:03 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ee73a12d-acfc-48d6-8fad-e1ddaecfb2f7 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 200 len: 1538 microversion: 2.1 time: 0.141548 Apr 14 05:59:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 193/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:03 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 1538 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:59:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] Creating event network-changed:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 05:59:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-840e0cac-5178-48c7-abac-fbca66d771aa req-95e0cbdd-6c39-478e-a10d-58076be5a043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034626 Apr 14 05:59:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 194/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "759ab340-42b3-420f-b44c-c4dd4ec6e190"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f6781ab7-18c7-4e17-925d-7098bee14845 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283137 Apr 14 05:59:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 190/577] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 05:59:05 2023] POST /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 05:59:07 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 HTTP/1.1 Apr 14 05:59:07 user devstack@n-api.service[61644]: Accept: application/json Apr 14 05:59:07 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 05:59:07 user devstack@n-api.service[61644]: Connection: close Apr 14 05:59:07 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 05:59:07 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 05:59:07 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 05:59:07 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 05:59:07 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:59:07 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 05:59:07 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 05:59:07 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 05:59:07 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 05:59:07 user devstack@n-api.service[61644]: method: > Apr 14 05:59:07 user devstack@n-api.service[61644]: exception: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 05:59:07 user devstack@n-api.service[61644]: action_args: {'id': '6d4a6a71-954f-4f37-8210-aa86e84828f8'} Apr 14 05:59:07 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 05:59:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 05:59:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:59:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c65e3724-af96-4623-9c8a-459834b9c722 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 404 len: 111 microversion: 2.1 time: 0.032121 Apr 14 05:59:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 194/578] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:07 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:59:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2135968135", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2009419178", "security_groups": [{"name": "tempest-secgroup-smoke-1262837136"}], "block_device_mapping_v2": [{"uuid": "74dc3ebd-bb57-4a6a-be70-a383598ad5ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:07 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:59:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-767513540", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:07 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] validate_networks() for [('49b7a0c9-3ca2-4c36-af90-eb33b55fde50', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:59:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74dc3ebd-bb57-4a6a-be70-a383598ad5ff',volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for user c4946885e01a4f0da206d796027b3c9f and project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:59:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3552e70f-39f8-4667-b081-d23e0fbc79a9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.733749 Apr 14 05:59:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 191/579] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 05:59:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 05:59:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-659e1ec3-7d40-4f2b-b39f-152413916db8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.108102 Apr 14 05:59:08 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 195/580] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:59:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:59:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f6c29205-d813-4a8d-82f6-5b98d9e832d8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f6c29205-d813-4a8d-82f6-5b98d9e832d8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9c3ad13d-cf06-4c21-86d1-2a47c0f81eda tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 200 len: 1394 microversion: 2.87 time: 0.076800 Apr 14 05:59:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 195/581] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:59:08 2023] GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 1394 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:59:08 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f6c29205-d813-4a8d-82f6-5b98d9e832d8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f6c29205-d813-4a8d-82f6-5b98d9e832d8 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 200 len: 1090 microversion: 2.1 time: 0.076937 Apr 14 05:59:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 192/582] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:08 2023] GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 1090 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:59:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] Creating event network-changed:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 05:59:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e982ca78-56de-4dd9-993c-129049f533c9 req-25d96e63-abcd-4eeb-ad46-9983504d83c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040726 Apr 14 05:59:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 196/583] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] Creating event network-changed:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 05:59:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-a0a76958-1bb9-40cc-a684-955d92677528 req-2e506498-1eed-40eb-a742-94e78c9e1bbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031027 Apr 14 05:59:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 196/584] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "name": "network-vif-plugged", "status": "completed", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] Creating event network-vif-plugged:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 05:59:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-bdf38ea8-2b41-43bf-9475-05e7a741a256 req-af5c0a78-1ce6-4e63-9edf-0120a00a109e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037816 Apr 14 05:59:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 193/585] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:14 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'services' on Instance uuid 54eb0cb5-4998-4afe-9312-e7a3ea009d05 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:59:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3778e8f7-0efd-416c-bbd7-d58d11679994 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments/759ab340-42b3-420f-b44c-c4dd4ec6e190" status: 202 len: 0 microversion: 2.1 time: 0.207347 Apr 14 05:59:14 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 197/586] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 05:59:14 2023] DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments/759ab340-42b3-420f-b44c-c4dd4ec6e190 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:14 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-452c24af-ea83-49d5-8dd8-19f120524959 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073088 Apr 14 05:59:14 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 197/587] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 05:59:14 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:15 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "name": "network-vif-plugged", "status": "completed", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] Creating event network-vif-plugged:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 05:59:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-24d8a980-719f-4b71-870a-b3866f949014 req-88352beb-9beb-4195-8fc7-74469e6dbb5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029877 Apr 14 05:59:15 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 194/588] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "name": "network-vif-plugged", "status": "completed", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] Creating event network-vif-plugged:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 05:59:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-0f73b19e-de38-4d58-8490-bfaef53c2d09 req-94496bc9-a169-420f-b834-69aedddfc634 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052358 Apr 14 05:59:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 198/589] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a10cb983-39cd-4c75-9f08-0dd9edca5415 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.146356 Apr 14 05:59:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 198/590] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 05:59:19 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-interface => generated 283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "name": "network-vif-plugged", "status": "completed", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] Creating event network-vif-plugged:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 05:59:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-e6f13448-3479-47d6-9006-6e434446258f req-0e412026-3fc4-4318-81fd-7069853d0400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063632 Apr 14 05:59:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 195/591] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d03f2354-9153-4aef-bdc1-569b889c533d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/ips" status: 200 len: 111 microversion: 2.20 time: 0.049337 Apr 14 05:59:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 199/592] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 05:59:21 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/ips => generated 111 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 05:59:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] Creating event network-changed:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-73a33aad-ad64-417e-9713-81d50ccfefca req-7af74dff-cce0-49c8-926f-1d48233c5e2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037554 Apr 14 05:59:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 199/593] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:23 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lazy-loading 'flavor' on Instance uuid b7f31928-32b3-4d1e-bb7c-7b4799ce6439 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ede02f21-ccb4-4131-8013-937728acaf1b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/action" status: 202 len: 0 microversion: 2.20 time: 0.953885 Apr 14 05:59:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 196/594] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 05:59:23 2023] POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/action => generated 0 bytes in 957 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:24 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9e2c72d1-e74a-4dca-bba4-b1bb689015ab tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.316795 Apr 14 05:59:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 200/595] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:24 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:59:25 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:25 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:25 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4f80679a-fcac-465d-90ee-045599546aaf tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1712 microversion: 2.20 time: 0.212196 Apr 14 05:59:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 200/596] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:59:24 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1712 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-unplugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] Creating event network-vif-unplugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-c67b570d-21f1-413e-ac1d-bd26759c577f req-00465ee5-0c86-4598-bd2a-1d34df1e4be1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063351 Apr 14 05:59:25 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 197/597] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:25 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ac95e1f2-9ee2-462d-b3b5-5fd2f8446d31 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.181195 Apr 14 05:59:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 201/598] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:25 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:59:27 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-unplugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}, {"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:27 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Creating event network-vif-unplugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-bbeed34b-c8be-4f0b-9e3d-bf1c59e5f8da req-ea78a1b8-bccf-4cc8-91af-43ffc62fa142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.043485 Apr 14 05:59:27 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 201/599] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] Creating event network-changed:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 05:59:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-15f502a2-9f39-439a-a186-3e470834986b req-c91b05cb-8fa2-4a8e-bc62-0e77f5731b96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031096 Apr 14 05:59:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 198/600] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=5 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 05:59:45 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 HTTP/1.1 Apr 14 05:59:45 user devstack@n-api.service[61645]: Accept: application/json Apr 14 05:59:45 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 05:59:45 user devstack@n-api.service[61645]: Connection: close Apr 14 05:59:45 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 05:59:45 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 05:59:45 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 05:59:45 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 05:59:45 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 05:59:45 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 05:59:45 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 05:59:45 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 05:59:45 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 05:59:45 user devstack@n-api.service[61645]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 05:59:45 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 05:59:45 user devstack@n-api.service[61645]: method: > Apr 14 05:59:45 user devstack@n-api.service[61645]: exception: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 05:59:45 user devstack@n-api.service[61645]: action_args: {'id': '8bc9e54a-dc25-421f-a380-a394b0867000'} Apr 14 05:59:45 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 05:59:45 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 05:59:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 05:59:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a5c42ced-095b-4737-b1c0-5694542f940b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 404 len: 111 microversion: 2.1 time: 0.036638 Apr 14 05:59:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 202/601] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:45 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 05:59:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ffead8c2-469b-4fae-b3d5-5e85f9cf646a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '.version_select at 0x7f55c87c4670>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ffead8c2-469b-4fae-b3d5-5e85f9cf646a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435197988" status: 202 len: 0 microversion: 2.1 time: 0.030363 Apr 14 05:59:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 202/602] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 05:59:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435197988 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 05:59:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a1dba95d-cee6-44ed-81a9-2c9b43be68a0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: .version_select at 0x7f55e28085e0>, body: {"keypair": {"name": "tempest-keypair-597319774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjST9Vq/RQ6pRTDrm1LbOsfcNfa1pbuGiC/r0eq7E3wVhoIdnwjwbWoGndyV/U8/jakU32Rad8q17apaLNEIBegaTidnfQE6Kt2hnJWaPy6aVHSpoc9Zhtwr72fSCPj9w=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:46 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a1dba95d-cee6-44ed-81a9-2c9b43be68a0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:59:46 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a1dba95d-cee6-44ed-81a9-2c9b43be68a0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for user 3aa9911d299b409f9ccc8a55e7b3ec5b and project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:59:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a1dba95d-cee6-44ed-81a9-2c9b43be68a0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059074 Apr 14 05:59:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 199/603] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 05:59:46 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-683982699", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d288d2c3-a523-4004-913b-b2eb8a3e32c6"}], "security_groups": [{"name": "tempest-securitygroup--1958328598"}], "key_name": "tempest-keypair-597319774", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:47 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] validate_networks() for [('d288d2c3-a523-4004-913b-b2eb8a3e32c6', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Getting quotas for user 3aa9911d299b409f9ccc8a55e7b3ec5b and project 5c0f5758b623402393ec9eb273c7ae6f. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 05:59:48 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 05:59:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-222cd8ad-8e09-4d30-8cdd-ebfc20b115be tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.657698 Apr 14 05:59:48 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 203/604] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 05:59:47 2023] POST /compute/v2.1/servers => generated 400 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 05:59:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d59f47c2-091d-492f-b389-df6f9f39e234 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d59f47c2-091d-492f-b389-df6f9f39e234 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:48 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d59f47c2-091d-492f-b389-df6f9f39e234 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d59f47c2-091d-492f-b389-df6f9f39e234 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 200 len: 1230 microversion: 2.1 time: 0.060985 Apr 14 05:59:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 203/605] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:48 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 1230 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 05:59:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] Creating event network-changed:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 05:59:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-58f54683-c97f-4265-b1fa-20c4f364d410 req-a5eb4efe-8ec5-4db6-bf41-493c0a4cf250 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039570 Apr 14 05:59:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 200/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 05:59:53 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-5680af9b-8ac2-4f91-9612-bd92bd32554a req-00fec579-5ca9-4c4e-a001-b22b582c4f43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073819 Apr 14 05:59:53 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 204/607] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 05:59:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 05:59:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-811149a5-2c8f-4c00-9b83-8bcd048184b9 req-d129667a-cac4-40a3-9712-6df7ac794264 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030373 Apr 14 05:59:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 204/608] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 05:59:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:58 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:58 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 05:59:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7a524149-ad02-4502-adbe-f75bb171cf3a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 200 len: 1691 microversion: 2.87 time: 0.274258 Apr 14 05:59:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 201/609] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 05:59:58 2023] GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 05:59:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e491ba7d-4689-45a8-9a65-1af94a656f80 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 200 len: 1443 microversion: 2.1 time: 0.238257 Apr 14 05:59:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 205/610] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 05:59:58 2023] GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 1443 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] HTTP exception thrown: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 06:00:03 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a HTTP/1.1 Apr 14 06:00:03 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:00:03 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:00:03 user devstack@n-api.service[61644]: Connection: close Apr 14 06:00:03 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:00:03 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:00:03 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:00:03 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:00:03 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:03 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61644]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:03 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:00:03 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:00:03 user devstack@n-api.service[61644]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 06:00:03 user devstack@n-api.service[61644]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:03 user devstack@n-api.service[61644]: method: > Apr 14 06:00:03 user devstack@n-api.service[61644]: exception: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61644]: action_args: {'id': 'b0e24f0f-175f-4259-b38d-4fb58ecc508a'} Apr 14 06:00:03 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 404 to user: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:00:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1e90a3a2-514a-4c16-9c46-c3003ee86369 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 404 len: 111 microversion: 2.1 time: 0.037337 Apr 14 06:00:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 205/611] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:00:03 2023] DELETE /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: b0e24f0f-175f-4259-b38d-4fb58ecc508a] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] HTTP exception thrown: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 06:00:03 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a HTTP/1.1 Apr 14 06:00:03 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:00:03 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:00:03 user devstack@n-api.service[61646]: Connection: close Apr 14 06:00:03 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:00:03 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:00:03 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:00:03 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:00:03 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:03 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:03 user devstack@n-api.service[61646]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:03 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:00:03 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:00:03 user devstack@n-api.service[61646]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 06:00:03 user devstack@n-api.service[61646]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:03 user devstack@n-api.service[61646]: method: > Apr 14 06:00:03 user devstack@n-api.service[61646]: exception: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61646]: action_args: {'id': 'b0e24f0f-175f-4259-b38d-4fb58ecc508a'} Apr 14 06:00:03 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. Apr 14 06:00:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:00:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 404 to user: Instance b0e24f0f-175f-4259-b38d-4fb58ecc508a could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:00:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9981f4ec-99d1-4089-bb84-60a2867e26b4 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a" status: 404 len: 111 microversion: 2.1 time: 0.032741 Apr 14 06:00:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 202/612] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:03 2023] GET /compute/v2.1/servers/b0e24f0f-175f-4259-b38d-4fb58ecc508a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:03 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:00:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e18433f5-a54f-4320-83a3-dca3d8ca6b89 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 204 len: 0 microversion: 2.1 time: 0.189260 Apr 14 06:00:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 206/613] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:00:03 2023] DELETE /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:03 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e56c03cd09f4a3882e8dffbbaa40c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '289cfed4776048b18eca85457a194bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-15dac0b2-5d4b-4117-88e2-90fab1078fd3 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 200 len: 1499 microversion: 2.1 time: 0.217473 Apr 14 06:00:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 206/614] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:03 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 1499 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:00:04 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "name": "network-vif-unplugged", "status": "completed", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:04 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] Creating event network-vif-unplugged:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 06:00:04 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-208bfb00-4f26-4ff8-93ae-d50419902699 req-d6efa7db-7a5c-481e-8231-dc7b4f840948 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029157 Apr 14 06:00:04 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 203/615] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-12443a3a-7200-4eca-82dd-de94a89efac2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064759 Apr 14 06:00:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 207/616] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:00:04 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:00:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "name": "network-vif-plugged", "status": "completed", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}, {"server_uuid": "88eea6fd-6dde-4692-891e-0587ae62d90c", "name": "network-vif-deleted", "tag": "0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Creating event network-vif-plugged:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 06:00:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] Creating event network-vif-deleted:0ab07a22-05c7-410d-bc4f-36cfc0e4c3f8 for instance 88eea6fd-6dde-4692-891e-0587ae62d90c on user Apr 14 06:00:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-1b65ff69-d40f-4ae5-aa71-6084bbfa09eb req-b1e931bd-51f5-4d37-a621-f3cda5f6da0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032602 Apr 14 06:00:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 207/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:00:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-2105900536"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-048acc6c-f237-4c46-9ecc-05ac9e5db310 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/action" status: 202 len: 0 microversion: 2.1 time: 0.718364 Apr 14 06:00:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 204/618] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:00:07 2023] POST /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:15 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-fb23a150-7716-450c-8b45-4d70eee7a811 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1653 microversion: 2.20 time: 0.171261 Apr 14 06:00:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 208/619] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:00:15 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1653 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=12 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-78804805", "imageRef": "4cbeb851-7902-440c-b088-480ecfc4ac6a", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1286641636", "security_groups": [{"name": "tempest-secgroup-smoke-807094077"}], "networks": [{"uuid": "854353ae-dcf2-46cd-8b84-8d47764d065c"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] validate_networks() for [('854353ae-dcf2-46cd-8b84-8d47764d065c', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:18 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:00:18 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Getting quotas for user 80e1861ede2547f1b3051829eaef8b7b and project ad1d1e07cab842139c5a42a9f98a0de3. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:00:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:00:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4cbeb851-7902-440c-b088-480ecfc4ac6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:00:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1ca1f070-7d81-4763-8647-bed6c96885ff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.693809 Apr 14 06:00:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 208/620] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:00:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:00:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8c66c4cb-71c8-41e0-99c2-405b07ec940f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8c66c4cb-71c8-41e0-99c2-405b07ec940f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:18 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:18 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-8c66c4cb-71c8-41e0-99c2-405b07ec940f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8c66c4cb-71c8-41e0-99c2-405b07ec940f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 200 len: 1235 microversion: 2.1 time: 0.069967 Apr 14 06:00:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 205/621] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:18 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:00:20 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] Creating event network-changed:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:00:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-aa84e3af-1910-4b72-9d83-960b84e15758 req-1f207db8-67da-4797-b862-3334839789ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044369 Apr 14 06:00:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 209/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:00:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:00:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "name": "network-vif-plugged", "status": "completed", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] Creating event network-vif-plugged:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:00:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-0fec30ec-d2d8-4cd4-921b-13766ff3cfcf req-54f0d7c0-9bd5-4f21-8a54-d511e25aeba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033472 Apr 14 06:00:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 209/623] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:00:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "name": "network-vif-plugged", "status": "completed", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] Creating event network-vif-plugged:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:00:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-8b075716-0ee4-4d89-a141-5799191b9c9b req-d6e3f081-f5bd-4294-9f5c-0edb87599077 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037925 Apr 14 06:00:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 206/624] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:00:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:25 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lazy-loading 'services' on Instance uuid 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:00:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-238d80cd-60ae-4493-8883-f0896e43f099 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments/c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a" status: 202 len: 0 microversion: 2.1 time: 0.197636 Apr 14 06:00:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 210/625] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:00:25 2023] DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments/c9b7cb4c-42d9-4f09-a9b8-3af5c56b5d1a => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-94db600a-13ac-4d45-91e8-6f0d587044cb tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Apr 14 06:00:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 210/626] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:00:25 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-70d7bfb7-dec9-4165-8851-d6b9a8c13303 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 200 len: 1536 microversion: 2.1 time: 0.245292 Apr 14 06:00:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 207/627] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:38 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 1536 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] [instance: 88eea6fd-6dde-4692-891e-0587ae62d90c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] HTTP exception thrown: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Request method failure captured: Apr 14 06:00:54 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c HTTP/1.1 Apr 14 06:00:54 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:00:54 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:00:54 user devstack@n-api.service[61645]: Connection: close Apr 14 06:00:54 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:00:54 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:00:54 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:00:54 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:00:54 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOnVyTjVlilotpvcs4K7NYWlZZ63AohNOx_XMmNdjyUJ8E4-vE4dNvjCZq7w8flVAVwEjjzy72bd32vu_pZ6G7rJI0jbA2pelvo6dlsHyg-KwlKc0BG6i7DFNCEh8vpFj7XhwkGcYcCfpWSZlW2mtmjnYqQavNzMktF_QFEmuC7NmAY Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Project-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Project-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/289cfed4776048b18eca85457a194bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/289cfed4776048b18eca85457a194bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Tenant: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Tenant-Id: 289cfed4776048b18eca85457a194bfb Apr 14 06:00:54 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1687375833 Apr 14 06:00:54 user devstack@n-api.service[61645]: X-User: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:54 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:00:54 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:00:54 user devstack@n-api.service[61645]: X-User-Id: 4e56c03cd09f4a3882e8dffbbaa40c97 Apr 14 06:00:54 user devstack@n-api.service[61645]: X-User-Name: tempest-ServersNegativeTestJSON-1687375833-project-member Apr 14 06:00:54 user devstack@n-api.service[61645]: method: > Apr 14 06:00:54 user devstack@n-api.service[61645]: exception: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. Apr 14 06:00:54 user devstack@n-api.service[61645]: action_args: {'id': '88eea6fd-6dde-4692-891e-0587ae62d90c'} Apr 14 06:00:54 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. Apr 14 06:00:54 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:00:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] Returning 404 to user: Instance 88eea6fd-6dde-4692-891e-0587ae62d90c could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:00:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-746312a0-794c-477c-a9cf-ec8d84f01154 tempest-ServersNegativeTestJSON-1687375833 tempest-ServersNegativeTestJSON-1687375833-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c" status: 404 len: 111 microversion: 2.1 time: 0.043564 Apr 14 06:00:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 211/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:54 2023] GET /compute/v2.1/servers/88eea6fd-6dde-4692-891e-0587ae62d90c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-148602065"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:00:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:00:59 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:00:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ea924b57-6750-4d2b-9160-9d92fda7ae0b tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 200 len: 1443 microversion: 2.1 time: 0.219092 Apr 14 06:00:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 211/629] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:00:58 2023] GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 1443 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:00:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e8b29639-f40f-4ad1-8d57-313fa14dddf9 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963/action" status: 202 len: 52 microversion: 2.87 time: 0.859541 Apr 14 06:00:59 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 208/630] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 06:00:58 2023] POST /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963/action => generated 52 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 06:01:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] Creating event network-changed:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 06:01:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-294e3cb1-ad3c-4884-9e10-fa173d438eb9 req-76a5cac5-85a7-4af1-9210-eabab4f9af10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031456 Apr 14 06:01:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 212/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:05 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:05 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:05 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1c74e76e-84f1-462b-b2c9-8f9fc3749a4a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 200 len: 1691 microversion: 2.87 time: 0.294682 Apr 14 06:01:05 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 212/632] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:01:04 2023] GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 1691 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:01:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1220323896", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2009419178", "security_groups": [{"name": "tempest-secgroup-smoke-1262837136"}], "block_device_mapping_v2": [{"uuid": "067a7ca8-6d68-40e7-8a27-bedd09b89208", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "452b97a0-6bab-4b84-b7ee-66bd6fb76446"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] validate_networks() for [('452b97a0-6bab-4b84-b7ee-66bd6fb76446', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Getting quotas for user 670c42ab26ab49808773a20f14269e13 and project 8134d4bfff8e465c8dc0a5342fee7e10. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:01:08 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ce441671-0e74-4836-be98-a82e4825d9c1 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 200 len: 1536 microversion: 2.1 time: 0.475437 Apr 14 06:01:08 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 213/633] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:08 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 1536 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:01:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='067a7ca8-6d68-40e7-8a27-bedd09b89208',volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:01:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-83e29d12-a7c9-4c7e-9285-7e1e4ededb0c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.880117 Apr 14 06:01:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 209/634] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:01:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:01:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c76044fe-f64b-4fd0-ac92-07355fdd9796 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c76044fe-f64b-4fd0-ac92-07355fdd9796 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c76044fe-f64b-4fd0-ac92-07355fdd9796 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c76044fe-f64b-4fd0-ac92-07355fdd9796 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 200 len: 1090 microversion: 2.1 time: 0.120974 Apr 14 06:01:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 213/635] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:08 2023] GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 1090 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:01:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] Creating event network-changed:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:01:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-46ffccd5-5d1d-4fe2-80d5-6de88d84dd99 req-58a54f3b-03e5-4d84-ac03-0e2bb9e18988 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040527 Apr 14 06:01:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 214/636] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9d5b3f5-065c-48b7-8f53-10a313bf28a7"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=12 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-fbb1a9c8-d73e-418c-8128-8b1838aa7c30 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051704 Apr 14 06:01:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 214/637] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:01:15 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:15 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-88a9cbdb-3e7c-47be-8c58-bcb365029600 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.546650 Apr 14 06:01:15 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 210/638] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 06:01:15 2023] POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments => generated 188 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 06:01:15 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:16 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ac4aa5b6-9cef-4e31-b621-4e4b0924bcb5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1677 microversion: 2.1 time: 0.183263 Apr 14 06:01:16 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 215/639] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:15 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c1f57bb7-5564-415d-bb56-0f2c39d41c03 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1677 microversion: 2.1 time: 0.167113 Apr 14 06:01:16 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 211/640] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:16 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a327fd40-6337-48a9-ab11-8e9a9c589b8c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments/e9d5b3f5-065c-48b7-8f53-10a313bf28a7" status: 202 len: 0 microversion: 2.20 time: 0.268422 Apr 14 06:01:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 215/641] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 06:01:15 2023] DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments/e9d5b3f5-065c-48b7-8f53-10a313bf28a7 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4b179a2b-af3a-4c4c-b9cf-1060f7e11e18 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1677 microversion: 2.1 time: 0.172224 Apr 14 06:01:16 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 216/642] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:16 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:01:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61646) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 06:01:16 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-c5844c39-c818-44fb-9b65-7713e32d31d4 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/action" status: 202 len: 0 microversion: 2.20 time: 0.141407 Apr 14 06:01:16 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 212/643] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 06:01:16 2023] POST /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4d004402-cb15-45d6-aa83-22c57b8a3184 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1661 microversion: 2.20 time: 0.261355 Apr 14 06:01:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 216/644] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:01:16 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1661 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:01:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "name": "network-vif-plugged", "status": "completed", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] Creating event network-vif-plugged:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:01:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-dbbfc9eb-1ef2-4637-94c1-19429cd36555 req-b88efa1b-1c5c-4db2-b3db-b37866fc4835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032027 Apr 14 06:01:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 217/645] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "name": "network-vif-plugged", "status": "completed", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}, {"name": "network-changed", "server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Creating event network-vif-plugged:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:01:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] Creating event network-changed:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:01:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-d0f41ebb-d86d-430d-ac6b-06455bad57ef req-f0b379ec-ff43-4e83-88cd-feadc60551ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043205 Apr 14 06:01:20 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 213/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:20 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:01:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-c18331fa-768d-4257-a231-7a04f3d37386 req-817de52b-8bc5-4081-a3a5-d7743d4e947d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049486 Apr 14 06:01:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 217/647] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=27 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:01:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-ae95e955-533e-48a2-a20f-39fb0998ebed req-4c407b99-a1b4-409d-a664-6a1391367747 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073810 Apr 14 06:01:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 218/648] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a709cc2f-0b09-4386-9f31-596fc7b92cae tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.166934 Apr 14 06:01:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 214/649] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:01:38 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=18 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] Creating event network-changed:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:01:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ecb79daa-ad19-4bea-ab61-069a2b1e7297 req-f3992896-34d7-4ba3-a977-6c7328878b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148496 Apr 14 06:01:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 218/650] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:01:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a45aa4d1-c912-4ec6-9a94-f4cc4f995b3b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/ips" status: 200 len: 104 microversion: 2.1 time: 0.106726 Apr 14 06:01:39 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 219/651] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:01:39 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/ips => generated 104 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4b730f2-8ef0-4043-b861-e3b145d94f5f"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:42 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:42 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-38d37526-a595-4eb2-b692-a0f79b6ec736 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275993 Apr 14 06:01:42 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 215/652] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:01:42 2023] POST /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-388901e0-1316-4ccb-a44d-6760e4fa07e4 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054476 Apr 14 06:01:50 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 219/653] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:01:50 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-153c2180-7b7c-4b6a-9a4e-1942a3d5ed80 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f" status: 200 len: 194 microversion: 2.1 time: 0.047102 Apr 14 06:01:50 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 220/654] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 06:01:50 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "924cc8d2-77f4-442e-8b3e-f04588940143"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-eba8a275-e509-40c5-af64-0d37842ed9b0 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281689 Apr 14 06:01:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 216/655] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:01:52 2023] POST /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:01:59 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:01:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-0757461a-d03f-4fb2-83cd-44e641171230 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 200 len: 1443 microversion: 2.1 time: 0.159474 Apr 14 06:01:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 220/656] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:01:59 2023] GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-aadcce50-c19a-4776-998e-496b92ee122a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048312 Apr 14 06:02:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 221/657] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:02:01 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-bdeb23c9-af11-4a7d-936d-22d06c6e3237 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f" status: 200 len: 194 microversion: 2.1 time: 0.042892 Apr 14 06:02:01 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 217/658] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 06:02:01 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:01 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'services' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:02:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a8a7f430-74bf-4b99-bafa-57a91c288b13 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f" status: 202 len: 0 microversion: 2.1 time: 0.169710 Apr 14 06:02:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 221/659] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:02:01 2023] DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/a4b730f2-8ef0-4043-b861-e3b145d94f5f => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-90c9055a-de48-46ee-8ecf-5ba080f1d02d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/924cc8d2-77f4-442e-8b3e-f04588940143" status: 200 len: 194 microversion: 2.1 time: 0.076789 Apr 14 06:02:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 222/660] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 06:02:04 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/924cc8d2-77f4-442e-8b3e-f04588940143 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:04 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lazy-loading 'services' on Instance uuid f06b97a7-d8e3-46e4-9e4d-3566f52ee22c {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:02:04 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5d2ec497-5802-4455-9763-f98594a3fc3a tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/924cc8d2-77f4-442e-8b3e-f04588940143" status: 202 len: 0 microversion: 2.1 time: 0.157839 Apr 14 06:02:04 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 218/661] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:02:04 2023] DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments/924cc8d2-77f4-442e-8b3e-f04588940143 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1234839153", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "destination_type": "volume"}], "networks": [{"uuid": "49b7a0c9-3ca2-4c36-af90-eb33b55fde50"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] validate_networks() for [('49b7a0c9-3ca2-4c36-af90-eb33b55fde50', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:06 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:02:06 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Getting quotas for user c4946885e01a4f0da206d796027b3c9f and project 7034e2177823496a861a1601a5c06fe4. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:02:06 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:02:06 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:02:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-dfe4439c-1b3e-4eb0-9035-c57ae9dd670f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.595141 Apr 14 06:02:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 222/662] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 06:02:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 06:02:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:06 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:06 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:06 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:06 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-508a9871-d0b8-4cb6-ad7f-8e9409ad2aa4 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1395 microversion: 2.87 time: 0.103019 Apr 14 06:02:06 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 223/663] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:02:06 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1395 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:07 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:07 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:07 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e7069b6f-7fea-4ee2-85f2-959de562ce51 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1706 microversion: 2.20 time: 0.216043 Apr 14 06:02:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 219/664] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:02:06 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1706 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b51ac422-f987-4b8e-b3bd-2b65f3c341f9 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048486 Apr 14 06:02:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 223/665] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:02:07 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9280dcac-2eb4-4fe0-a7b6-b35c76bef1bc tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053118 Apr 14 06:02:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 224/666] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:02:07 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:02:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-98b70b39-220a-4c81-b8d2-c7c380903b78 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 204 len: 0 microversion: 2.1 time: 0.142607 Apr 14 06:02:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 220/667] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:02:08 2023] DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa9911d299b409f9ccc8a55e7b3ec5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c0f5758b623402393ec9eb273c7ae6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-df6a3950-fb29-438c-8510-526286e4935e tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 200 len: 1660 microversion: 2.1 time: 0.256898 Apr 14 06:02:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 224/668] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:08 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 1660 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:02:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-unplugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] Creating event network-vif-unplugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-6ffe7787-8bc5-4bc7-a834-77204c198e89 req-cd549e53-aaf4-44be-8926-fb8ca9e3f030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115949 Apr 14 06:02:08 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 225/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] Creating event network-changed:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:02:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-3a096fc7-886f-410c-980b-d4d1b50e4e66 req-4258d8ee-b02f-4bba-8aff-b7daa0e8412f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040828 Apr 14 06:02:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 225/670] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:09 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d3ff0992-d98c-4c42-8f2f-4e0ce7e88dfb tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 200 len: 1536 microversion: 2.1 time: 0.390308 Apr 14 06:02:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 221/671] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:08 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 1536 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:02:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}, {"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}, {"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}, {"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-plugged", "status": "completed", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}, {"server_uuid": "f06b97a7-d8e3-46e4-9e4d-3566f52ee22c", "name": "network-vif-deleted", "tag": "907e4f56-85d9-4e2b-a241-f5fe7eded6fb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Creating event network-vif-plugged:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] Creating event network-vif-deleted:907e4f56-85d9-4e2b-a241-f5fe7eded6fb for instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c on user Apr 14 06:02:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e89ea8e1-8a0c-4902-94e7-45578ca5fa8c req-5ee69f94-32be-4b30-aeef-e5590ec48281 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.050100 Apr 14 06:02:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 226/672] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] Creating event network-changed:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:02:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-d9d69a59-6f47-4060-b47d-0303bde0f82d req-9d663dfe-ff8f-4b2e-aca3-81cb6af6546f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033724 Apr 14 06:02:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 226/673] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0575b5c4-2389-490d-8bb9-1e5188e5e81e"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-53ec88a8-2e90-40dc-b119-52a0bb7b8517 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282568 Apr 14 06:02:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 222/674] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:02:11 2023] POST /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:19 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-94bd5b25-9fb0-419b-b357-e4a1cf600b89 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1677 microversion: 2.1 time: 0.288381 Apr 14 06:02:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 227/675] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:18 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1677 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1c1a968-04ba-403c-8a35-91dd18d10550"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-34414288-b192-4154-b6a9-0fe159890c9b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314035 Apr 14 06:02:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 227/676] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:02:19 2023] POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:19 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lazy-loading 'services' on Instance uuid 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:02:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-92591453-91ba-480a-9d2c-15d46085f5f2 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments/0575b5c4-2389-490d-8bb9-1e5188e5e81e" status: 202 len: 0 microversion: 2.1 time: 0.197899 Apr 14 06:02:20 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 223/677] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:02:19 2023] DELETE /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments/0575b5c4-2389-490d-8bb9-1e5188e5e81e => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-be03e86e-dfed-4b7b-8fa8-7808a3c0858c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051895 Apr 14 06:02:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 228/678] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:02:20 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:02:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-8202ecfd-263a-4388-864f-b6bd5f3612d9 req-657d6dea-5b63-40f6-8e01-4469287a108c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045197 Apr 14 06:02:24 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 228/679] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:26 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:02:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-67527c10-0818-4f40-905a-d41efd0a477f req-d89b5a10-4240-46c5-ba4c-608cf102bed8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044408 Apr 14 06:02:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 224/680] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Old instance type m1.nano, new instance type m1.micro {{(pid=61645) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:02:27 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:02:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8d6cffe5-47a1-45e7-a5d8-88fa70f5c7a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action" status: 202 len: 0 microversion: 2.1 time: 0.349339 Apr 14 06:02:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 229/681] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:02:27 2023] POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:27 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9cbe973a-9b38-48ad-bbc2-8144502c6ba6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1732 microversion: 2.1 time: 0.172899 Apr 14 06:02:27 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 229/682] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:27 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:02:30 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-unplugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Creating event network-vif-unplugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:02:30 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:02:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a37b4141-1d46-41c5-83a9-24e7b9a6b961 req-2acf9d10-f817-4abe-8d5d-b5b02c287be6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050949 Apr 14 06:02:30 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 225/683] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=35 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:32 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:02:32 user devstack@n-api.service[61645]: DEBUG nova.compute.api [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61645) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:02:32 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-829333ae-9751-43fc-a70f-bb7f37b123cb req-18b548b0-7f37-4cf8-92d4-5b86e557b0a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078938 Apr 14 06:02:32 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 230/684] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:35 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f583b96d-e92a-4887-b19e-32fb622a5149 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: .version_select at 0x7f55e29323b0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-543536161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY8ZVbsTmU4ya1X7CGgOE6pcyq/4JaVNXY5tpenUcguUdFE8Kr0l/yOIZh+Yt4iEVbu9gJoTSw/kQyo17gRa6Ht+rT1wWxHk+Zl701QDRQbrj4e5WxGPZquLRvwOzCLNQ=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:35 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-f583b96d-e92a-4887-b19e-32fb622a5149 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting quotas for project 95ed03c728ca4f37b84f644a501f3f85. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:02:35 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-f583b96d-e92a-4887-b19e-32fb622a5149 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting quotas for user 44c8bc2bd90742dab8b74d340bd9d9b7 and project 95ed03c728ca4f37b84f644a501f3f85. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:02:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f583b96d-e92a-4887-b19e-32fb622a5149 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.158041 Apr 14 06:02:35 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 230/685] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:02:35 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-364162703", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-543536161", "security_groups": [{"name": "tempest-secgroup-smoke-38858389"}], "networks": [{"uuid": "6110eea6-64ff-49e4-9ef9-6b9be59a7a52"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:37 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] validate_networks() for [('6110eea6-64ff-49e4-9ef9-6b9be59a7a52', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting quotas for project 95ed03c728ca4f37b84f644a501f3f85. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Getting quotas for user 44c8bc2bd90742dab8b74d340bd9d9b7 and project 95ed03c728ca4f37b84f644a501f3f85. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:02:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:02:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f0823655-bb85-4b11-939f-2fe3d940eeb4 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676842 Apr 14 06:02:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 226/686] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:02:37 2023] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:02:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e35504fa-ee94-4405-bce3-d49850414567 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e35504fa-ee94-4405-bce3-d49850414567 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-e35504fa-ee94-4405-bce3-d49850414567 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c8bc2bd90742dab8b74d340bd9d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ed03c728ca4f37b84f644a501f3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e35504fa-ee94-4405-bce3-d49850414567 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 200 len: 1255 microversion: 2.1 time: 0.084586 Apr 14 06:02:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 231/687] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:38 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 1255 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:02:41 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=7 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] Creating event network-changed:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:02:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-356d3721-806f-4926-b2ac-8f2615e5055a req-787ffeec-d3fb-4f43-8049-9a1277d10e92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032806 Apr 14 06:02:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 231/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:43 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "name": "network-vif-plugged", "status": "completed", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] Creating event network-vif-plugged:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:02:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-2f09ead4-d16c-42ff-865b-f219dfc66d3c req-fc762312-4190-46f0-a581-003fca834f4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031588 Apr 14 06:02:43 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 227/689] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:02:44 user devstack@n-api.service[61645]: DEBUG nova.compute.api [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61645) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:02:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-6680460b-c8c2-40d1-8add-858731c14595 req-fa1fadf4-ad0b-470d-9ecc-6897ec57b17e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050991 Apr 14 06:02:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 232/690] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "name": "network-vif-plugged", "status": "completed", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] Creating event network-vif-plugged:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:02:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-82a0ffef-f000-42f8-b1e0-6a98c1c3fb8e req-770536cc-4345-43aa-ace5-8916d7b531db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030429 Apr 14 06:02:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 232/691] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:02:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:02:46 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:02:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b4361a4a-0602-4c19-b619-7ee0dc6deae1 req-129ac591-8718-4278-997f-e4f2ca4adc23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035759 Apr 14 06:02:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 228/692] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=7 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:56 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-85c7c149-bbde-4a56-a0ef-5dc65c5228b5 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1770 microversion: 2.87 time: 0.164460 Apr 14 06:02:56 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 233/693] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:02:56 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1770 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 06:02:58 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c HTTP/1.1 Apr 14 06:02:58 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:02:58 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:02:58 user devstack@n-api.service[61644]: Connection: close Apr 14 06:02:58 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:02:58 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:02:58 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:02:58 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:02:58 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:02:58 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:02:58 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:02:58 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:02:58 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:02:58 user devstack@n-api.service[61644]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 06:02:58 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:02:58 user devstack@n-api.service[61644]: method: > Apr 14 06:02:58 user devstack@n-api.service[61644]: exception: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:02:58 user devstack@n-api.service[61644]: action_args: {'id': 'f06b97a7-d8e3-46e4-9e4d-3566f52ee22c'} Apr 14 06:02:58 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:02:58 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:02:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:02:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a4ff8a56-db3d-4feb-bf8b-d0cfdcdd3599 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 404 len: 111 microversion: 2.1 time: 0.075076 Apr 14 06:02:58 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 233/694] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:58 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:02:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=13 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:02:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-eb55b34c-6b8d-4dad-941b-586cf7901e9b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '.version_select at 0x7f55e28e41f0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-eb55b34c-6b8d-4dad-941b-586cf7901e9b tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-597319774" status: 202 len: 0 microversion: 2.1 time: 0.031029 Apr 14 06:02:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 229/695] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 06:02:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-597319774 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:02:59 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:02:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c55ede25-e516-4f12-ab0b-4db615303f6e tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 200 len: 1443 microversion: 2.1 time: 0.161828 Apr 14 06:02:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 234/696] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:02:59 2023] GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] Creating event network-changed:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:03:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-fcb45572-aa28-40ed-bcad-0cdf1365b17f req-5204e74c-8e73-475f-9bf8-8eec966cfba6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066430 Apr 14 06:03:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 234/697] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:02 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] Creating event network-changed:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:03:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:03:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-160d2776-27dc-4513-a9ba-ccaca42214ab req-f9d7910a-dfb9-47f2-ad24-0c0d71526196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040189 Apr 14 06:03:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 235/698] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e80a2046-0820-4384-841d-7d5831bbd11c tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 204 len: 0 microversion: 2.1 time: 0.121433 Apr 14 06:03:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 230/699] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:03:02 2023] DELETE /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:03 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-71942dac-690f-4880-85a4-13b90f82c465 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 200 len: 1568 microversion: 2.1 time: 0.390935 Apr 14 06:03:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 235/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:02 2023] GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "name": "network-vif-unplugged", "status": "completed", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}, {"server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "name": "network-vif-plugged", "status": "completed", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Creating event network-vif-unplugged:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:03:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] Creating event network-vif-plugged:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:03:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-5cac138e-dca5-48b0-bc9b-ad1198ed011f req-b79e25d9-88de-4370-a811-191591a05f64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.043727 Apr 14 06:03:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 236/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de510bdc-eedf-4497-82e4-15ebfaa9c7a7", "name": "network-vif-deleted", "tag": "0f49c87f-7d73-49ea-9910-4bed42d15edf"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] Creating event network-vif-deleted:0f49c87f-7d73-49ea-9910-4bed42d15edf for instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 on user Apr 14 06:03:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-20480017-cf5b-45cc-a530-fb67f2fbdee5 req-4493723a-e4a7-4ac6-9bb3-a8aa04b54059 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029950 Apr 14 06:03:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 231/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 06:03:06 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c HTTP/1.1 Apr 14 06:03:06 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:03:06 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:03:06 user devstack@n-api.service[61644]: Connection: close Apr 14 06:03:06 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:03:06 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:03:06 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:03:06 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:03:06 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:06 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:06 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:03:06 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:03:06 user devstack@n-api.service[61644]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 06:03:06 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:06 user devstack@n-api.service[61644]: method: > Apr 14 06:03:06 user devstack@n-api.service[61644]: exception: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61644]: action_args: {'id': 'f06b97a7-d8e3-46e4-9e4d-3566f52ee22c'} Apr 14 06:03:06 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-87ba9953-95b9-422e-aead-cc7eabce9f83 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 404 len: 111 microversion: 2.1 time: 0.039474 Apr 14 06:03:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 236/703] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:03:06 2023] DELETE /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: f06b97a7-d8e3-46e4-9e4d-3566f52ee22c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 06:03:06 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c HTTP/1.1 Apr 14 06:03:06 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:03:06 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:03:06 user devstack@n-api.service[61645]: Connection: close Apr 14 06:03:06 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:03:06 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:03:06 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:03:06 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:03:06 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:06 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:06 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:06 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:03:06 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:03:06 user devstack@n-api.service[61645]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 06:03:06 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:06 user devstack@n-api.service[61645]: method: > Apr 14 06:03:06 user devstack@n-api.service[61645]: exception: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61645]: action_args: {'id': 'f06b97a7-d8e3-46e4-9e4d-3566f52ee22c'} Apr 14 06:03:06 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. Apr 14 06:03:06 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:06 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance f06b97a7-d8e3-46e4-9e4d-3566f52ee22c could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:06 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-f3bf8203-2734-40f3-ae25-374912aca40f tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c" status: 404 len: 111 microversion: 2.1 time: 0.048203 Apr 14 06:03:06 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 237/704] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:06 2023] GET /compute/v2.1/servers/f06b97a7-d8e3-46e4-9e4d-3566f52ee22c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-638342ff-1d5a-4fe6-8f08-118fcdd1ad9f tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046758 Apr 14 06:03:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 232/705] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 06:03:07 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:03:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-2614eb56-6f4b-4eeb-8db3-5c41c0dca7bc tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 204 len: 0 microversion: 2.20 time: 0.134272 Apr 14 06:03:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 237/706] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:03:07 2023] DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7fece08f6f649bb89fc8ae5121bc2cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a335a6c17041473ca2abf256cb30a25f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-70fbb806-3e97-482a-8d6d-d629e4eaa86c tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 200 len: 1712 microversion: 2.20 time: 0.246345 Apr 14 06:03:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 238/707] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:03:07 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 1712 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-unplugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] Creating event network-vif-unplugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:03:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-451703d3-d8d1-49e0-aa4f-50bf438208c1 req-4669c7c5-28ee-42b8-a2f3-c4d0db313573 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033619 Apr 14 06:03:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 233/708] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-deleted", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] Creating event network-vif-deleted:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:03:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-8a74efe9-dbc4-4a5a-bafe-d39aebc0ef66 req-de47672f-b0d2-4ba8-bdc8-3bb1fd603356 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042334 Apr 14 06:03:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 238/709] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 06:03:09 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 HTTP/1.1 Apr 14 06:03:09 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:03:09 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:03:09 user devstack@n-api.service[61645]: Connection: close Apr 14 06:03:09 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:03:09 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:03:09 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:03:09 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:03:09 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:09 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:09 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:03:09 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:03:09 user devstack@n-api.service[61645]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 06:03:09 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:09 user devstack@n-api.service[61645]: method: > Apr 14 06:03:09 user devstack@n-api.service[61645]: exception: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61645]: action_args: {'id': '8bc9e54a-dc25-421f-a380-a394b0867000'} Apr 14 06:03:09 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-fff53478-fe3e-4cb2-b227-fc7c569dd01d tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 404 len: 111 microversion: 2.1 time: 0.040341 Apr 14 06:03:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 239/710] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:03:09 2023] DELETE /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] [instance: 8bc9e54a-dc25-421f-a380-a394b0867000] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] HTTP exception thrown: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Request method failure captured: Apr 14 06:03:09 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 HTTP/1.1 Apr 14 06:03:09 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:03:09 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:03:09 user devstack@n-api.service[61646]: Connection: close Apr 14 06:03:09 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:03:09 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:03:09 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:03:09 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:03:09 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOljm4iiPp3aFwKYla-29HpVgcTvCW2T8CcNS8DNJVai_4zSzfFY85gvYTedCMea6kNX3FZltH-dVRSg_6GK8pfpboMr5lHX2pVFLMMm6-ffb6j-2a5JgImGE1cr3tmvVkCgzk8CYivYEdE6cCT6vlJPvVz3DwJJagSnZurkMN9RhpE Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Project-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5c0f5758b623402393ec9eb273c7ae6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Tenant-Id: 5c0f5758b623402393ec9eb273c7ae6f Apr 14 06:03:09 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1872023683 Apr 14 06:03:09 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:09 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:03:09 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:03:09 user devstack@n-api.service[61646]: X-User-Id: 3aa9911d299b409f9ccc8a55e7b3ec5b Apr 14 06:03:09 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeTestJSON-1872023683-project-member Apr 14 06:03:09 user devstack@n-api.service[61646]: method: > Apr 14 06:03:09 user devstack@n-api.service[61646]: exception: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61646]: action_args: {'id': '8bc9e54a-dc25-421f-a380-a394b0867000'} Apr 14 06:03:09 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. Apr 14 06:03:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:03:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] Returning 404 to user: Instance 8bc9e54a-dc25-421f-a380-a394b0867000 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a1438ecd-fdba-4d59-919f-f13e1bbb9820 tempest-AttachVolumeTestJSON-1872023683 tempest-AttachVolumeTestJSON-1872023683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000" status: 404 len: 111 microversion: 2.1 time: 0.030690 Apr 14 06:03:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 234/711] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:09 2023] GET /compute/v2.1/servers/8bc9e54a-dc25-421f-a380-a394b0867000 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f31928-32b3-4d1e-bb7c-7b4799ce6439", "name": "network-vif-plugged", "status": "completed", "tag": "164b82d4-a91d-462e-9018-d6ef229e6aec"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] Creating event network-vif-plugged:164b82d4-a91d-462e-9018-d6ef229e6aec for instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 on user Apr 14 06:03:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ee3f2fff-968a-4d5d-ada0-bc2145191a98 req-f0664e56-bd3f-43f5-9544-5b2c01d430a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035105 Apr 14 06:03:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 239/712] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-63a818e8-b548-4c91-afbc-32079fa31040 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053544 Apr 14 06:03:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 240/713] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:03:10 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:03:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fd360def-bd5e-45be-aeb0-dc1d653b7568 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 204 len: 0 microversion: 2.1 time: 0.117638 Apr 14 06:03:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 235/714] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:03:10 2023] DELETE /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:11 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b5d22974-b27b-48cf-af06-a72ae545292f tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 200 len: 1661 microversion: 2.1 time: 0.234110 Apr 14 06:03:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 240/715] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:11 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 1661 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] Creating event network-changed:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:03:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-12670c0d-4d7d-4ce9-ab51-5c17b31955f0 req-b11bd505-a846-4ddc-89d2-28736a4312dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031069 Apr 14 06:03:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 241/716] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "name": "network-vif-deleted", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] Creating event network-vif-deleted:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:03:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-dd7b4db8-e054-42ac-9269-4bf4efcc1f63 req-acd5d309-e60f-4c38-a89b-28e2e465bc84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042478 Apr 14 06:03:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 236/717] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "name": "network-vif-unplugged", "status": "completed", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}, {"server_uuid": "3f1c0a57-5272-4d8e-a1d7-204c843a1a22", "name": "network-vif-plugged", "status": "completed", "tag": "3250a79a-10f7-4b4f-bd5c-a70104f878dd"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Creating event network-vif-unplugged:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:03:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] Creating event network-vif-plugged:3250a79a-10f7-4b4f-bd5c-a70104f878dd for instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 on user Apr 14 06:03:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-a23d67a6-6dd6-4964-ad10-19fb3d7565fc req-880e58e9-2239-4672-b996-c7aa7a36aedb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028821 Apr 14 06:03:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 241/718] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3f1c4dcf-0ffe-4f26-b191-4602fd86c79a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1731 microversion: 2.1 time: 0.194549 Apr 14 06:03:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 242/719] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:17 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:28 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c8bc2bd90742dab8b74d340bd9d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ed03c728ca4f37b84f644a501f3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-142f184f-e4c2-4a5e-8ad8-b330345f429d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 200 len: 1566 microversion: 2.1 time: 0.172690 Apr 14 06:03:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 237/720] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:28 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: de510bdc-eedf-4497-82e4-15ebfaa9c7a7] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 06:03:53 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 HTTP/1.1 Apr 14 06:03:53 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:03:53 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:03:53 user devstack@n-api.service[61644]: Connection: close Apr 14 06:03:53 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:03:53 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:03:53 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:03:53 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:03:53 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:03:53 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:03:53 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:03:53 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 06:03:53 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:03:53 user devstack@n-api.service[61644]: method: > Apr 14 06:03:53 user devstack@n-api.service[61644]: exception: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. Apr 14 06:03:53 user devstack@n-api.service[61644]: action_args: {'id': 'de510bdc-eedf-4497-82e4-15ebfaa9c7a7'} Apr 14 06:03:53 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. Apr 14 06:03:53 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance de510bdc-eedf-4497-82e4-15ebfaa9c7a7 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b43cbd7d-58cd-455b-9a4d-e0dea00bd4ec tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7" status: 404 len: 111 microversion: 2.1 time: 0.300813 Apr 14 06:03:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 242/721] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:53 2023] GET /compute/v2.1/servers/de510bdc-eedf-4497-82e4-15ebfaa9c7a7 => generated 111 bytes in 302 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:03:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a5bf2eb1-2fd1-477e-b7d1-0748c06ec48c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: .version_select at 0x7f55e27c49d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-231549131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVDVuZxgP6T2IopyVcHDdZNThJjwKeMuN8DramwlrXcrn8VCbcLqHqBE3vvw1uInUsIuqdv/74zpirpbQBeAoaIJz1NWGtyXXGiI15gus+WidHndaCvrtXHIBgSchsOXQ=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=22 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=40 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:55 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-a5bf2eb1-2fd1-477e-b7d1-0748c06ec48c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:03:55 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-a5bf2eb1-2fd1-477e-b7d1-0748c06ec48c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for user b59b8f9b395149c7a2eef067766f0935 and project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:03:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a5bf2eb1-2fd1-477e-b7d1-0748c06ec48c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.071097 Apr 14 06:03:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 243/722] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:03:55 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-330157663", "imageRef": "860c1218-de7d-4a5c-9ad4-d8cc754d539e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-231549131", "networks": [{"uuid": "bbe6141e-3cce-47df-aec9-bf81eb18830c"}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] validate_networks() for [('bbe6141e-3cce-47df-aec9-bf81eb18830c', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for user b59b8f9b395149c7a2eef067766f0935 and project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:03:56 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='860c1218-de7d-4a5c-9ad4-d8cc754d539e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:03:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f8d62817-d7d3-4590-b35e-c8106c42d74e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.571929 Apr 14 06:03:56 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 238/723] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:03:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:03:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-07a5559a-1650-42e1-b16b-224c4e1cdd18 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:56 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-07a5559a-1650-42e1-b16b-224c4e1cdd18 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:56 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-07a5559a-1650-42e1-b16b-224c4e1cdd18 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-07a5559a-1650-42e1-b16b-224c4e1cdd18 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1251 microversion: 2.1 time: 0.064666 Apr 14 06:03:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 243/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:03:56 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1251 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "739fc5fe-1f68-47a9-bd9b-3ff39b4eea65"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:56 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lazy-loading 'flavor' on Instance uuid e9f3555f-72fe-416f-8264-9c20053a00b0 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:03:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d65b438a-8fd3-4c6a-b527-d408c79a00eb tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0/action" status: 200 len: 29 microversion: 2.87 time: 0.516659 Apr 14 06:03:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 244/725] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 06:03:56 2023] POST /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0/action => generated 29 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:57 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:03:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-15e0bb4c-cbbb-4a00-b1e9-33510824d5f3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1776 microversion: 2.87 time: 0.201397 Apr 14 06:03:57 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 239/726] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:03:57 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1776 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 06:03:57 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 HTTP/1.1 Apr 14 06:03:57 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:03:57 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:03:57 user devstack@n-api.service[61644]: Connection: close Apr 14 06:03:57 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:03:57 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:03:57 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:03:57 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:03:57 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:03:57 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:03:57 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:03:57 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:03:57 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:03:57 user devstack@n-api.service[61644]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 06:03:57 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:03:57 user devstack@n-api.service[61644]: method: > Apr 14 06:03:57 user devstack@n-api.service[61644]: exception: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:03:57 user devstack@n-api.service[61644]: action_args: {'id': 'b7f31928-32b3-4d1e-bb7c-7b4799ce6439'} Apr 14 06:03:57 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:03:57 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:03:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:03:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b68946fd-27ed-41ff-9bf7-5d6ecf391c34 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 404 len: 111 microversion: 2.20 time: 0.032663 Apr 14 06:03:57 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 244/727] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:03:57 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:03:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-43c7ae6b-912b-469e-b2cf-b2704f56f9ab tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '.version_select at 0x7f55e27c5090>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:03:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-43c7ae6b-912b-469e-b2cf-b2704f56f9ab tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281561404" status: 204 len: 0 microversion: 2.20 time: 0.056290 Apr 14 06:03:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 245/728] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 06:03:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281561404 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 06:03:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-unplugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] Creating event network-vif-unplugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:03:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b1c64e48-6337-4671-ad9b-d2cde75a6662 req-6932428c-2821-4743-acab-41afe8080dc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040854 Apr 14 06:03:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 240/729] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:03:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:03:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:03:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:03:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:03:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] Creating event network-changed:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:03:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-fb379eca-5bde-4485-88a4-8881d29628fe req-9073c30c-c810-4e6d-b5df-4ccba197024b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036311 Apr 14 06:03:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 245/730] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:03:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:04:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e6bd82a1-b611-48a4-aeab-f1ec8349ad3c req-9031ade4-ca1e-47a4-ab38-9f67401ae27a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036421 Apr 14 06:04:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 246/731] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:04:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-dde231b2-29d3-4c8c-a044-e993a0cc7331 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 204 len: 0 microversion: 2.1 time: 0.157508 Apr 14 06:04:01 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 241/732] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:04:01 2023] DELETE /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 3f1c0a57-5272-4d8e-a1d7-204c843a1a22] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] HTTP exception thrown: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Request method failure captured: Apr 14 06:04:01 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 HTTP/1.1 Apr 14 06:04:01 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:04:01 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:04:01 user devstack@n-api.service[61645]: Connection: close Apr 14 06:04:01 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:04:01 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:04:01 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:04:01 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:04:01 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOssl_Z_S1SnjPYAhefi3bu1i-_BS2iHXSIRsSt85Y0Mf77ZweHBKAoDuFEf5B2YEraYmcqx6ZjQiQHOA93UE59kWd_kX30pY8R-1am_x6RmpdnAnFg5FNYDPJxvnxDn7pQnSOdCDt3h83ksEjGMuYj1jyXrOMU01CoZt3mO9IGRhLQ Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Project-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestStampPattern-43185348 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Tenant: tempest-TestStampPattern-43185348 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Tenant-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestStampPattern-43185348 Apr 14 06:04:01 user devstack@n-api.service[61645]: X-User: tempest-TestStampPattern-43185348-project-member Apr 14 06:04:01 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:04:01 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:04:01 user devstack@n-api.service[61645]: X-User-Id: 80e1861ede2547f1b3051829eaef8b7b Apr 14 06:04:01 user devstack@n-api.service[61645]: X-User-Name: tempest-TestStampPattern-43185348-project-member Apr 14 06:04:01 user devstack@n-api.service[61645]: method: > Apr 14 06:04:01 user devstack@n-api.service[61645]: exception: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. Apr 14 06:04:01 user devstack@n-api.service[61645]: action_args: {'id': '3f1c0a57-5272-4d8e-a1d7-204c843a1a22'} Apr 14 06:04:01 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. Apr 14 06:04:01 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Returning 404 to user: Instance 3f1c0a57-5272-4d8e-a1d7-204c843a1a22 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a6db1dd0-19d2-4531-949f-6aaf6ef7684a tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22" status: 404 len: 111 microversion: 2.1 time: 0.041162 Apr 14 06:04:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 247/733] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:01 2023] GET /compute/v2.1/servers/3f1c0a57-5272-4d8e-a1d7-204c843a1a22 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:04:01 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670c42ab26ab49808773a20f14269e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8134d4bfff8e465c8dc0a5342fee7e10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-21c8ce4a-b5ca-457c-a0a2-d46b5b671fba tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 200 len: 1567 microversion: 2.1 time: 0.265149 Apr 14 06:04:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 246/734] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:01 2023] GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "name": "network-vif-unplugged", "status": "completed", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] Creating event network-vif-unplugged:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 06:04:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-65d0db7f-e886-4c32-be98-e72159ad326a req-8ebfb561-7094-47d2-88ee-18ce1ddf74aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034575 Apr 14 06:04:01 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 242/735] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:02 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] Creating event network-changed:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 06:04:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-673c70a4-660e-4ec1-9a73-b357d659f673 req-e78f7dfe-31d0-4bd3-aba3-fd51f002d0be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035688 Apr 14 06:04:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 248/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 06:04:03 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 HTTP/1.1 Apr 14 06:04:03 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:04:03 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:04:03 user devstack@n-api.service[61644]: Connection: close Apr 14 06:04:03 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:04:03 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:04:03 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:04:03 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:04:03 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:03 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:03 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:04:03 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:04:03 user devstack@n-api.service[61644]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 06:04:03 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:03 user devstack@n-api.service[61644]: method: > Apr 14 06:04:03 user devstack@n-api.service[61644]: exception: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61644]: action_args: {'id': 'b7f31928-32b3-4d1e-bb7c-7b4799ce6439'} Apr 14 06:04:03 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7e334a77-cf4a-4611-83ac-9fda19bb3f4d tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 404 len: 111 microversion: 2.20 time: 0.040181 Apr 14 06:04:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 247/737] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:04:03 2023] DELETE /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: b7f31928-32b3-4d1e-bb7c-7b4799ce6439] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 06:04:03 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 HTTP/1.1 Apr 14 06:04:03 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:04:03 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:04:03 user devstack@n-api.service[61646]: Connection: close Apr 14 06:04:03 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:04:03 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:04:03 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:04:03 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:04:03 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:03 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:03 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:03 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:04:03 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:04:03 user devstack@n-api.service[61646]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 06:04:03 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:03 user devstack@n-api.service[61646]: method: > Apr 14 06:04:03 user devstack@n-api.service[61646]: exception: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61646]: action_args: {'id': 'b7f31928-32b3-4d1e-bb7c-7b4799ce6439'} Apr 14 06:04:03 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. Apr 14 06:04:03 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance b7f31928-32b3-4d1e-bb7c-7b4799ce6439 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-32e98d87-2a51-4281-bed2-9e63727d2f05 tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439" status: 404 len: 111 microversion: 2.20 time: 0.033365 Apr 14 06:04:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 243/738] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:04:03 2023] GET /compute/v2.1/servers/b7f31928-32b3-4d1e-bb7c-7b4799ce6439 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:04:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "name": "network-vif-plugged", "status": "completed", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:03 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] Creating event network-vif-plugged:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 06:04:03 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-4270d5dc-0c05-44dd-880a-04c050da8a64 req-8da41e07-3a8f-4354-926f-632f9e4db82d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046384 Apr 14 06:04:03 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 249/739] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8995825-7362-44ef-87b2-33c1f9f02e56", "name": "network-vif-deleted", "tag": "6a6b02b3-33b5-4330-9fa9-036ff4c19650"}, {"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}, {"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}, {"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Creating event network-vif-deleted:6a6b02b3-33b5-4330-9fa9-036ff4c19650 for instance d8995825-7362-44ef-87b2-33c1f9f02e56 on user Apr 14 06:04:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:04:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:04:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:04:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f32af5ca-2e54-43bd-ac3c-5a7bb14289a0 req-c0289149-3f86-4fbc-8381-abb168ea677d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054115 Apr 14 06:04:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 248/740] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:04 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:04:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-43e9b0ff-0d1a-4a77-b457-8f442d045348 req-a280a9af-b4c1-4e5b-883b-421fe224a80b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040956 Apr 14 06:04:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 244/741] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] HTTP exception thrown: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 is not attached to volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Request method failure captured: Apr 14 06:04:09 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments/759ab340-42b3-420f-b44c-c4dd4ec6e190 HTTP/1.1 Apr 14 06:04:09 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:04:09 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:04:09 user devstack@n-api.service[61645]: Connection: close Apr 14 06:04:09 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:04:09 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:04:09 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:04:09 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:04:09 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOssl_Z_S1SnjPYAhefi3bu1i-_BS2iHXSIRsSt85Y0Mf77ZweHBKAoDuFEf5B2YEraYmcqx6ZjQiQHOA93UE59kWd_kX30pY8R-1am_x6RmpdnAnFg5FNYDPJxvnxDn7pQnSOdCDt3h83ksEjGMuYj1jyXrOMU01CoZt3mO9IGRhLQ Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Project-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestStampPattern-43185348 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Tenant: tempest-TestStampPattern-43185348 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Tenant-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestStampPattern-43185348 Apr 14 06:04:09 user devstack@n-api.service[61645]: X-User: tempest-TestStampPattern-43185348-project-member Apr 14 06:04:09 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61645]: X-User-Id: 80e1861ede2547f1b3051829eaef8b7b Apr 14 06:04:09 user devstack@n-api.service[61645]: X-User-Name: tempest-TestStampPattern-43185348-project-member Apr 14 06:04:09 user devstack@n-api.service[61645]: method: > Apr 14 06:04:09 user devstack@n-api.service[61645]: exception: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 is not attached to volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 Apr 14 06:04:09 user devstack@n-api.service[61645]: action_args: {'server_id': '54eb0cb5-4998-4afe-9312-e7a3ea009d05', 'id': '759ab340-42b3-420f-b44c-c4dd4ec6e190'} Apr 14 06:04:09 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 759ab340-42b3-420f-b44c-c4dd4ec6e190. Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 is not attached to volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 is not attached to volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 Apr 14 06:04:09 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Returning 404 to user: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 is not attached to volume 759ab340-42b3-420f-b44c-c4dd4ec6e190 {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2082d764-eac9-45ee-8c62-ce493d613dff tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments/759ab340-42b3-420f-b44c-c4dd4ec6e190" status: 404 len: 154 microversion: 2.1 time: 0.177959 Apr 14 06:04:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 250/742] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:04:09 2023] DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05/os-volume_attachments/759ab340-42b3-420f-b44c-c4dd4ec6e190 => generated 154 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 06:04:09 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea HTTP/1.1 Apr 14 06:04:09 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:04:09 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:04:09 user devstack@n-api.service[61644]: Connection: close Apr 14 06:04:09 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:04:09 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:04:09 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:04:09 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:04:09 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:09 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:09 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61644]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 06:04:09 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:09 user devstack@n-api.service[61644]: method: > Apr 14 06:04:09 user devstack@n-api.service[61644]: exception: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61644]: action_args: {'id': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea'} Apr 14 06:04:09 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1d62e343-85b9-41e6-88c0-60109d4bbe0a tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 404 len: 111 microversion: 2.20 time: 0.042381 Apr 14 06:04:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 249/743] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:04:09 2023] DELETE /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] [instance: 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] HTTP exception thrown: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Request method failure captured: Apr 14 06:04:09 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea HTTP/1.1 Apr 14 06:04:09 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:04:09 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:04:09 user devstack@n-api.service[61646]: Connection: close Apr 14 06:04:09 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:04:09 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:04:09 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:04:09 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:04:09 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOmOcMnWX6tNAMFTp8vEh0A0vVAQLEXomjwWVmb04gxoU929qnKnEx3YCCxwkFOJV6as93wUTbs2DfMJA9HAH_bIq-5R7VLrb0JpiVXImi8HF2tDr41Is5-PTbmhcZ1oyrpFkFAc_wNZF7nsP9ezAuKnjsWabI6SVNBQRTaQSCbq3z4 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Project-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a335a6c17041473ca2abf256cb30a25f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Tenant-Id: a335a6c17041473ca2abf256cb30a25f Apr 14 06:04:09 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1611001218 Apr 14 06:04:09 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:09 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:04:09 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:04:09 user devstack@n-api.service[61646]: X-User-Id: e7fece08f6f649bb89fc8ae5121bc2cc Apr 14 06:04:09 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1611001218-project-member Apr 14 06:04:09 user devstack@n-api.service[61646]: method: > Apr 14 06:04:09 user devstack@n-api.service[61646]: exception: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61646]: action_args: {'id': '87153a66-bf2c-45f5-aa66-c94eaa6ea7ea'} Apr 14 06:04:09 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. Apr 14 06:04:09 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] Returning 404 to user: Instance 87153a66-bf2c-45f5-aa66-c94eaa6ea7ea could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ade618cb-f5c5-4146-9a8b-1dcf208fa13b tempest-AttachVolumeShelveTestJSON-1611001218 tempest-AttachVolumeShelveTestJSON-1611001218-project-member] 10.0.0.210 "GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea" status: 404 len: 111 microversion: 2.20 time: 0.036075 Apr 14 06:04:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 245/744] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:04:09 2023] GET /compute/v2.1/servers/87153a66-bf2c-45f5-aa66-c94eaa6ea7ea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] Creating event network-changed:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 06:04:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-111b93c2-5bb8-4729-98c6-378688d6e51d req-772738e2-edd6-4db2-bd84-4f3291520a2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Apr 14 06:04:10 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 250/745] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:04:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-67a1c24b-1ab9-4c0a-b8d8-5205760b830c tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 204 len: 0 microversion: 2.1 time: 0.147310 Apr 14 06:04:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 251/746] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:04:10 2023] DELETE /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:10 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80e1861ede2547f1b3051829eaef8b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad1d1e07cab842139c5a42a9f98a0de3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8989e98c-fdc1-454a-ab94-a655fc7b2aab tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 200 len: 1663 microversion: 2.1 time: 0.335998 Apr 14 06:04:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 246/747] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:10 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 1663 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:04:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "name": "network-vif-unplugged", "status": "completed", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] Creating event network-vif-unplugged:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 06:04:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e0f43cef-3596-4b90-be16-e8a81d99ebd3 req-3ee33bc9-f028-4768-8573-6a54ccbe0e4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033710 Apr 14 06:04:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 251/748] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "name": "network-vif-deleted", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] Creating event network-vif-deleted:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 06:04:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-92a0dbb2-4ed6-4c6a-a89f-055e0764a07e req-296cf80b-530c-4ca4-aa36-061c57db5421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039456 Apr 14 06:04:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 252/749] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54eb0cb5-4998-4afe-9312-e7a3ea009d05", "name": "network-vif-plugged", "status": "completed", "tag": "9d24e5dc-5be4-4df3-acba-fb447e4c980a"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] Creating event network-vif-plugged:9d24e5dc-5be4-4df3-acba-fb447e4c980a for instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 on user Apr 14 06:04:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-06386b93-e3b2-4533-b098-c5b73c35700b req-7be5a170-8bcb-4fbe-b9d9-341ad7a9d76b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031291 Apr 14 06:04:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 247/750] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-10d83096-1f73-47d1-959e-45e790a1cc6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action" status: 202 len: 0 microversion: 2.1 time: 0.369999 Apr 14 06:04:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 252/751] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:04:18 2023] POST /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:18 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a8b74fd7-91f9-4a30-ad5d-da38ba91f34a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1730 microversion: 2.1 time: 0.175962 Apr 14 06:04:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 253/752] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:18 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:04:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-unplugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Creating event network-vif-unplugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:04:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:04:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-5aa62195-39e6-4894-9f7e-3addba36d0f2 req-ffccf4c7-63d3-4bd2-8c6f-821126cadf37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041517 Apr 14 06:04:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 248/753] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:04:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:04:22 user devstack@n-api.service[61644]: DEBUG nova.compute.api [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61644) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:04:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ba9d4eee-6758-4275-ad61-44b060a5b781 req-5db94ba9-e13a-49a7-aa5f-5fdf3e52e053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047409 Apr 14 06:04:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 253/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:28 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c8bc2bd90742dab8b74d340bd9d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ed03c728ca4f37b84f644a501f3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5a4eae2e-8e17-4a36-a1c4-30e8ea5fcb93 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 200 len: 1566 microversion: 2.1 time: 0.270730 Apr 14 06:04:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 254/755] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:28 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:04:30 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:04:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-8e4a84a5-8755-4507-b572-5066d98d8341 req-7ac5fac7-78d3-45e3-a577-83de4e452d60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056756 Apr 14 06:04:30 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 249/756] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:32 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:32 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:04:32 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-13f3c124-e028-4ec9-8cec-479c891eb01a req-6af16832-5230-4285-b32b-ce43e90aba83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042038 Apr 14 06:04:32 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 254/757] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] Creating event network-changed:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:04:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-be718b54-c5fd-499e-9220-874fc13b8c1b req-7a26fd72-c34a-44e4-9098-209d939751ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069543 Apr 14 06:04:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 255/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:04:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c84d6b06-fafa-4793-a9c1-cebd22b35294"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ae4e8c2e-5fe0-4557-a0da-95dbece99659 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430851 Apr 14 06:04:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 250/759] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:04:33 2023] POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:46 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e25abc17-a33e-40e1-a7d8-a05713d0aaef tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1535 microversion: 2.1 time: 0.164378 Apr 14 06:04:46 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 255/760] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:46 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=7 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:47 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:04:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2805d4be-7e8b-467a-ac69-476848178f13 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1756 microversion: 2.87 time: 0.190486 Apr 14 06:04:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 256/761] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:04:47 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: d8995825-7362-44ef-87b2-33c1f9f02e56] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 06:04:51 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 HTTP/1.1 Apr 14 06:04:51 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:04:51 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:04:51 user devstack@n-api.service[61646]: Connection: close Apr 14 06:04:51 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:04:51 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:04:51 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:04:51 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:04:51 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:51 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:04:51 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:04:51 user devstack@n-api.service[61646]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 06:04:51 user devstack@n-api.service[61646]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:51 user devstack@n-api.service[61646]: method: > Apr 14 06:04:51 user devstack@n-api.service[61646]: exception: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. Apr 14 06:04:51 user devstack@n-api.service[61646]: action_args: {'id': 'd8995825-7362-44ef-87b2-33c1f9f02e56'} Apr 14 06:04:51 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. Apr 14 06:04:51 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:04:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance d8995825-7362-44ef-87b2-33c1f9f02e56 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fa8d2ea3-5ac2-4bcd-97eb-bea100be502d tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56" status: 404 len: 111 microversion: 2.1 time: 0.043067 Apr 14 06:04:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 251/762] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:51 2023] GET /compute/v2.1/servers/d8995825-7362-44ef-87b2-33c1f9f02e56 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 06:04:52 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 HTTP/1.1 Apr 14 06:04:52 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:04:52 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:04:52 user devstack@n-api.service[61644]: Connection: close Apr 14 06:04:52 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:04:52 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:04:52 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:04:52 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:04:52 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:52 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:04:52 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:04:52 user devstack@n-api.service[61644]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 06:04:52 user devstack@n-api.service[61644]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:52 user devstack@n-api.service[61644]: method: > Apr 14 06:04:52 user devstack@n-api.service[61644]: exception: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61644]: action_args: {'id': '6d4a6a71-954f-4f37-8210-aa86e84828f8'} Apr 14 06:04:52 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9444b2bc-c3b9-474b-aca9-d057a4176a0a tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 404 len: 111 microversion: 2.1 time: 0.035808 Apr 14 06:04:52 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 256/763] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:04:52 2023] DELETE /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] [instance: 6d4a6a71-954f-4f37-8210-aa86e84828f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] HTTP exception thrown: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Request method failure captured: Apr 14 06:04:52 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 HTTP/1.1 Apr 14 06:04:52 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:04:52 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:04:52 user devstack@n-api.service[61645]: Connection: close Apr 14 06:04:52 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:04:52 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:04:52 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:04:52 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:04:52 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOj6Znm5WwI5GMJH1PF2jqimlDhQe76fl1kXFuLBSwWzNABsUrVl1eGTzvS1TtggL-5SR7LsFnJJfUYeucikJKUA7hy443-U2U4VmF0Uf-f7N-N7c8qZw8G4R0-sVjTvdA83SAFNGrr1Z-kyYe0cy--So8yHmyNY2H1SWa9bwNm7dmQ Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Project-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8134d4bfff8e465c8dc0a5342fee7e10"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Tenant: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Tenant-Id: 8134d4bfff8e465c8dc0a5342fee7e10 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestVolumeBootPattern-2132265128 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-User: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:52 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:04:52 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:04:52 user devstack@n-api.service[61645]: X-User-Id: 670c42ab26ab49808773a20f14269e13 Apr 14 06:04:52 user devstack@n-api.service[61645]: X-User-Name: tempest-TestVolumeBootPattern-2132265128-project-member Apr 14 06:04:52 user devstack@n-api.service[61645]: method: > Apr 14 06:04:52 user devstack@n-api.service[61645]: exception: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61645]: action_args: {'id': '6d4a6a71-954f-4f37-8210-aa86e84828f8'} Apr 14 06:04:52 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. Apr 14 06:04:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:04:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Returning 404 to user: Instance 6d4a6a71-954f-4f37-8210-aa86e84828f8 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:04:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4da87c22-51e4-40f7-b4f4-e0aeaf69f123 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8" status: 404 len: 111 microversion: 2.1 time: 0.031005 Apr 14 06:04:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 257/764] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:04:52 2023] GET /compute/v2.1/servers/6d4a6a71-954f-4f37-8210-aa86e84828f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:55 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'services' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:04:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-dd88b05b-3440-4175-a217-0ad5a2e37990 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/c84d6b06-fafa-4793-a9c1-cebd22b35294" status: 202 len: 0 microversion: 2.1 time: 0.172573 Apr 14 06:04:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 252/765] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:04:55 2023] DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/c84d6b06-fafa-4793-a9c1-cebd22b35294 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:04:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:04:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d0f39e9d-26d4-4892-9068-a48ff7dd8878 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] Calling method '.version_select at 0x7f55e27c5b40>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:04:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d0f39e9d-26d4-4892-9068-a48ff7dd8878 tempest-TestVolumeBootPattern-2132265128 tempest-TestVolumeBootPattern-2132265128-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2009419178" status: 202 len: 0 microversion: 2.1 time: 0.025482 Apr 14 06:04:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 258/766] 10.0.0.210 () {62 vars in 1340 bytes} [Fri Apr 14 06:04:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2009419178 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:04:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b65dd40c-c480-46cd-ad5b-edf1b56be2f2 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069490 Apr 14 06:04:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 257/767] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:04:55 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] [instance: 54eb0cb5-4998-4afe-9312-e7a3ea009d05] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] HTTP exception thrown: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Request method failure captured: Apr 14 06:05:00 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 HTTP/1.1 Apr 14 06:05:00 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:05:00 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:05:00 user devstack@n-api.service[61646]: Connection: close Apr 14 06:05:00 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:05:00 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:05:00 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:05:00 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:05:00 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOssl_Z_S1SnjPYAhefi3bu1i-_BS2iHXSIRsSt85Y0Mf77ZweHBKAoDuFEf5B2YEraYmcqx6ZjQiQHOA93UE59kWd_kX30pY8R-1am_x6RmpdnAnFg5FNYDPJxvnxDn7pQnSOdCDt3h83ksEjGMuYj1jyXrOMU01CoZt3mO9IGRhLQ Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Project-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Project-Name: tempest-TestStampPattern-43185348 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad1d1e07cab842139c5a42a9f98a0de3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Tenant: tempest-TestStampPattern-43185348 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Tenant-Id: ad1d1e07cab842139c5a42a9f98a0de3 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TestStampPattern-43185348 Apr 14 06:05:00 user devstack@n-api.service[61646]: X-User: tempest-TestStampPattern-43185348-project-member Apr 14 06:05:00 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:05:00 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:05:00 user devstack@n-api.service[61646]: X-User-Id: 80e1861ede2547f1b3051829eaef8b7b Apr 14 06:05:00 user devstack@n-api.service[61646]: X-User-Name: tempest-TestStampPattern-43185348-project-member Apr 14 06:05:00 user devstack@n-api.service[61646]: method: > Apr 14 06:05:00 user devstack@n-api.service[61646]: exception: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. Apr 14 06:05:00 user devstack@n-api.service[61646]: action_args: {'id': '54eb0cb5-4998-4afe-9312-e7a3ea009d05'} Apr 14 06:05:00 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. Apr 14 06:05:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:05:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Returning 404 to user: Instance 54eb0cb5-4998-4afe-9312-e7a3ea009d05 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:05:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f0f11953-a966-485e-91c0-b97380282869 tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05" status: 404 len: 111 microversion: 2.1 time: 0.029788 Apr 14 06:05:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 253/768] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:05:00 2023] GET /compute/v2.1/servers/54eb0cb5-4998-4afe-9312-e7a3ea009d05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:05:04 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-0756e817-aa89-42ff-8a59-ced353e5dbae tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] Calling method '.version_select at 0x7f55e27c4310>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-0756e817-aa89-42ff-8a59-ced353e5dbae tempest-TestStampPattern-43185348 tempest-TestStampPattern-43185348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1286641636" status: 202 len: 0 microversion: 2.1 time: 0.031860 Apr 14 06:05:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 259/769] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:05:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1286641636 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=14 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b22aa0be-dde7-413a-bde5-be391bad3303 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.244789 Apr 14 06:05:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 258/770] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:05:08 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1512759437", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] validate_networks() for None {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Getting quotas for project 2da761d3e4e148b592b6edda8197ce00. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Getting quotas for user a6991107308f4db89290f32efd2ac63e and project 2da761d3e4e148b592b6edda8197ce00. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:05:21 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:05:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d0dab328-78cf-46aa-a079-c7027dca51bb tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.461005 Apr 14 06:05:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 254/771] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:05:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:05:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d6524f72-13a5-4065-8489-03321392ec20 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d6524f72-13a5-4065-8489-03321392ec20 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:21 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d6524f72-13a5-4065-8489-03321392ec20 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6991107308f4db89290f32efd2ac63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da761d3e4e148b592b6edda8197ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d6524f72-13a5-4065-8489-03321392ec20 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" status: 200 len: 1209 microversion: 2.1 time: 0.075579 Apr 14 06:05:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 260/772] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:05:21 2023] GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:24 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] Creating event network-changed:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:05:24 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e962e999-2985-4438-b8ec-172e57ba61c1 req-33574a91-c7f7-448c-816f-76501bc98d05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032487 Apr 14 06:05:24 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 259/773] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:26 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "name": "network-vif-plugged", "status": "completed", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] Creating event network-vif-plugged:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:05:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b241e2c8-1eef-4466-b177-5447c407893a req-30ee9f33-8471-45bc-acf2-4e325957a1fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030494 Apr 14 06:05:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 255/774] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "name": "network-vif-plugged", "status": "completed", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] Creating event network-vif-plugged:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:05:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-889f17df-cf23-46d7-b7d7-90b7dc5af7d7 req-082ec2da-824b-48db-addd-083feb299432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033250 Apr 14 06:05:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 261/775] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1ea3a3b4-3a94-4a36-bb4f-c81632579986 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051126 Apr 14 06:05:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 260/776] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:05:45 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f86c79d7-d0f9-40b5-8f4a-7e8929e31e11 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1535 microversion: 2.1 time: 0.160974 Apr 14 06:05:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 256/777] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:05:46 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1535 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Searching by: {'deleted': False, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35'} {{(pid=61645) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.compute.multi_cell_list [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61645) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 06:05:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-40ab6596-961f-4c36-98b7-2f40c65ef17d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.522135 Apr 14 06:05:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 262/778] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 06:05:47 2023] GET /compute/v2.1/servers => generated 340 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-3840cdfa-8f8d-49ff-a029-f6b14636c221 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1535 microversion: 2.1 time: 0.188310 Apr 14 06:05:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 261/779] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:05:47 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1535 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:05:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7dc0a236-9b70-4b74-a1fd-67f1d2cb2573 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0/action" status: 202 len: 0 microversion: 2.87 time: 0.075314 Apr 14 06:05:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 257/780] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 06:05:47 2023] POST /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:48 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:48 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:48 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:05:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d8390ccf-0a56-475c-9905-e2936a91cc2d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1764 microversion: 2.87 time: 0.164773 Apr 14 06:05:48 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 263/781] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:05:47 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1764 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:05:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-unplugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] Creating event network-vif-unplugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:05:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-8d45413f-dab9-44c0-bbb0-c2133866f387 req-c8b66035-f80f-45fc-b2d2-0e9d81cc27b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040823 Apr 14 06:05:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 262/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05b8da5c-e217-45e4-9a73-283be85b52c5"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-081061bb-959c-4243-8907-46ef146598a1 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280520 Apr 14 06:05:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 258/783] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:05:49 2023] POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfc58917-7df1-4372-b516-1afa6e0ad1bb"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:05:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-6833921f-2d1c-4f0a-82fe-85224d0cc053 req-8dd0500d-b09c-400a-b03f-b26c799043e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037067 Apr 14 06:05:50 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 263/784] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a066baed-036a-4234-83f8-b213e2e6c18b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334317 Apr 14 06:05:50 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 264/785] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:05:50 2023] POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:52 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}, {"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:05:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:05:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:05:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-c9443231-8877-4967-9aed-82d26dddceb4 req-03ea8ac6-adbd-4761-829e-6fec8aba5d9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114930 Apr 14 06:05:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 259/786] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:57 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'services' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:05:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1efe21bf-e9de-4c25-b030-510c3c252188 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/05b8da5c-e217-45e4-9a73-283be85b52c5" status: 202 len: 0 microversion: 2.1 time: 0.175538 Apr 14 06:05:57 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 264/787] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:05:57 2023] DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/05b8da5c-e217-45e4-9a73-283be85b52c5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:05:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:05:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-795b4661-5a57-4047-be98-f69e3623ac6d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070670 Apr 14 06:05:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 265/788] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:05:57 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:02 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ee096755-78df-443b-9ff9-19b3a2aafa2f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1581 microversion: 2.1 time: 0.147083 Apr 14 06:06:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 260/789] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:02 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1581 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:03 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:03 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] Creating event network-changed:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:03 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-56afb8bb-ee0b-411a-a270-550bf93b04c7 req-17aa589a-8a86-4f54-b2d5-8fb3af18b60e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035560 Apr 14 06:06:03 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 265/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-208869714"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:05 user devstack@n-api.service[61645]: INFO nova.network.security_group_api [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Adding security group 00210d38-a241-4c48-b457-19b96a0929b1 to port 5803dbac-c755-47eb-93a1-ff9e122638f9 Apr 14 06:06:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-66412f1a-7daf-44cd-9eb5-97984d21d51d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action" status: 202 len: 0 microversion: 2.1 time: 0.592406 Apr 14 06:06:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 266/791] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:06:05 2023] POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:05 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] Creating event network-changed:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7fddf484-a8c2-4423-9701-fc4505448ecc req-e54f3385-a401-401e-90a9-b973ce72dab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159460 Apr 14 06:06:05 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 266/792] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:06:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e52712d4-8e0e-4926-9d2b-cf2a66de2767 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1746 microversion: 2.1 time: 0.169788 Apr 14 06:06:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 261/793] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:05 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-748d7710-cd43-422c-8c3f-f9556c759133 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.240286 Apr 14 06:06:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 267/794] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:08 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-bec9c5f6-30e8-4e0d-a74a-1352731b2b7e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1723 microversion: 2.1 time: 0.243933 Apr 14 06:06:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 267/795] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:09 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2ec6c8da-62fc-4144-8b15-8af0e3230d36 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action" status: 202 len: 0 microversion: 2.1 time: 0.092951 Apr 14 06:06:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 262/796] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:06:09 2023] POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c28359f9-94f5-4c29-88c7-1230fbf52364 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1748 microversion: 2.1 time: 0.181482 Apr 14 06:06:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 268/797] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:09 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1748 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-unplugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] Creating event network-vif-unplugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b11ce1ca-844c-45c4-9943-9095c0d31df2 req-9af6bf84-a7b8-4a90-a945-571e8d041639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031626 Apr 14 06:06:10 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 268/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:12 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6991107308f4db89290f32efd2ac63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da761d3e4e148b592b6edda8197ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fbce27e8-45d0-48be-8c7a-13234293e755 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" status: 200 len: 1454 microversion: 2.1 time: 0.149906 Apr 14 06:06:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 263/799] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:11 2023] GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:06:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c935ea05-9869-411c-9dc9-bfdb525fca2d req-70a9da96-f672-4f3d-ae45-043775052818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037675 Apr 14 06:06:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 269/800] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:14 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-d8bb40f8-80b9-4d51-8b5b-8d15612cd098 req-c0e7467f-d0fd-42d7-a7ef-69ffee6f0f56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043194 Apr 14 06:06:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 269/801] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=17 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:06:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-2155380c-4286-448e-8185-8fbc485ad92b req-b9f107fe-3b13-4618-8d9d-f24b9f2c5c83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038021 Apr 14 06:06:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 264/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:06:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=18 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:38 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-884939af-f37f-4d5e-9f26-1575a3c24098 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1770 microversion: 2.87 time: 0.183659 Apr 14 06:06:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 270/803] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:06:38 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1770 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=20 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:48 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ed9b32fb-d24c-4c0e-8bf7-19b1b50ee320 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051226 Apr 14 06:06:48 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 270/804] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:06:48 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c8fdf2b-ea2a-4577-b25c-831bdd32a848"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a4a21d14-12a2-4e0b-b1dd-809ae9d51bee tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.347526 Apr 14 06:06:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 265/805] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:06:51 2023] POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:06:59 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:06:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-78f2c3c4-6ad6-4a65-b9ac-6e3072883ba0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1746 microversion: 2.1 time: 0.171470 Apr 14 06:06:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 271/806] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:06:59 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:00 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'services' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:07:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-734c48b8-16aa-49d6-8bcb-2c19aeaf4396 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/7c8fdf2b-ea2a-4577-b25c-831bdd32a848" status: 202 len: 0 microversion: 2.1 time: 0.260043 Apr 14 06:07:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 271/807] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:07:00 2023] DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/7c8fdf2b-ea2a-4577-b25c-831bdd32a848 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-568f7dd8-244e-4818-bb88-29df3c60f854 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051205 Apr 14 06:07:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 266/808] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:07:00 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:07:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3e972ffe-ae18-4c8d-b735-08a68574270f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 204 len: 0 microversion: 2.1 time: 0.195417 Apr 14 06:07:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 272/809] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:07:09 2023] DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:09 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:07:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c599ef27-08c2-49bc-a2e1-515b2861849e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 200 len: 1729 microversion: 2.1 time: 0.192259 Apr 14 06:07:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 272/810] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:07:09 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:07:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-unplugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] Creating event network-vif-unplugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:07:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-7bd8233b-fa2f-40be-a136-4615d7005313 req-430988e4-8702-4bed-8f7e-d436935718cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086654 Apr 14 06:07:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 267/811] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:07:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-plugged", "status": "completed", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}, {"server_uuid": "4e8ac55a-5fe7-470b-b04e-97a9f00f3187", "name": "network-vif-deleted", "tag": "98a0c510-de09-47fb-b8cc-7a053b97eb82"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Creating event network-vif-plugged:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:07:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] Creating event network-vif-deleted:98a0c510-de09-47fb-b8cc-7a053b97eb82 for instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 on user Apr 14 06:07:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-10afbeb7-0b55-4891-91af-dd029a51310d req-3b1b982b-af66-4796-a53f-fcf6285f8002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030989 Apr 14 06:07:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 273/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:07:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:12 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:07:12 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e23eb1c9-8a6a-40ef-9f2a-7a16f6db27ce tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" status: 204 len: 0 microversion: 2.1 time: 0.123752 Apr 14 06:07:12 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 273/813] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:07:12 2023] DELETE /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:12 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6991107308f4db89290f32efd2ac63e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da761d3e4e148b592b6edda8197ce00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:07:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9140bfa7-858e-4c2a-b6ac-31422df447f6 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" status: 200 len: 1460 microversion: 2.1 time: 0.150517 Apr 14 06:07:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 268/814] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:07:12 2023] GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => generated 1460 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:07:14 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "name": "network-vif-unplugged", "status": "completed", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}, {"server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "name": "network-vif-plugged", "status": "completed", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}, {"server_uuid": "6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf", "name": "network-vif-deleted", "tag": "85a2a34f-7864-4659-90be-ecf0c970ce09"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Creating event network-vif-unplugged:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:07:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Creating event network-vif-plugged:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:07:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] Creating event network-vif-deleted:85a2a34f-7864-4659-90be-ecf0c970ce09 for instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf on user Apr 14 06:07:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-47429743-f718-44ac-a2a8-717f46e26d2d req-853c2378-d481-4660-aa08-907f0e03a19d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032272 Apr 14 06:07:14 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 274/815] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:38 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:07:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f7e743dd-8a39-4199-baf8-60c9ea33a79f tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 204 len: 0 microversion: 2.87 time: 0.256053 Apr 14 06:07:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 274/816] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:07:38 2023] DELETE /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:07:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:07:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fec2685e-60f9-44bb-8a9a-b635a88ed56d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 200 len: 1776 microversion: 2.87 time: 0.184192 Apr 14 06:07:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 269/817] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:07:38 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 1776 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-unplugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] Creating event network-vif-unplugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:07:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-a588c1fe-f3a4-410f-a0d3-808fa5123395 req-19a91f6f-40f0-4960-9ebc-e7daef54bb17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057985 Apr 14 06:07:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 275/818] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-plugged", "status": "completed", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}, {"server_uuid": "e9f3555f-72fe-416f-8264-9c20053a00b0", "name": "network-vif-deleted", "tag": "075d60ed-d208-452b-a993-da51fb4bfd77"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Creating event network-vif-plugged:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:07:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] Creating event network-vif-deleted:075d60ed-d208-452b-a993-da51fb4bfd77 for instance e9f3555f-72fe-416f-8264-9c20053a00b0 on user Apr 14 06:07:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-670c2e57-7559-45a1-9a75-2d77b7c9a0da req-5ceefa87-ee80-4439-abda-339605e637d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045382 Apr 14 06:07:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 275/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:50 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:50 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-df00d567-f013-46bf-ab80-909084fda85e tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.204103 Apr 14 06:07:50 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 270/820] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:07:50 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54d090c3-2714-4bf5-9b41-58a1b7420b84"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-deeaa846-13a1-47de-b70c-bb5c6cde5fd0 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277892 Apr 14 06:07:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 276/821] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:07:54 2023] POST /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:07:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:08:00 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 HTTP/1.1 Apr 14 06:08:00 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:08:00 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:08:00 user devstack@n-api.service[61644]: Connection: close Apr 14 06:08:00 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:08:00 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:08:00 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:08:00 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:08:00 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61644]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61644]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:08:00 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61644]: method: > Apr 14 06:08:00 user devstack@n-api.service[61644]: exception: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61644]: action_args: {'id': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'} Apr 14 06:08:00 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b05bab6d-0c7f-4a49-b63c-b2d8b0e957d8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 404 len: 111 microversion: 2.1 time: 0.044252 Apr 14 06:08:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 276/822] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:07:59 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:08:00 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments HTTP/1.1 Apr 14 06:08:00 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:08:00 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:08:00 user devstack@n-api.service[61646]: Connection: close Apr 14 06:08:00 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:08:00 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:08:00 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:08:00 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:08:00 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61646]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61646]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:08:00 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61646]: method: > Apr 14 06:08:00 user devstack@n-api.service[61646]: exception: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61646]: action_args: {'server_id': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'} Apr 14 06:08:00 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ac9ca033-3172-4879-9038-0f56d6b2f9cc tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029573 Apr 14 06:08:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 271/823] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:08:00 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:08:00 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 HTTP/1.1 Apr 14 06:08:00 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:08:00 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:08:00 user devstack@n-api.service[61645]: Connection: close Apr 14 06:08:00 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:08:00 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:08:00 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:08:00 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:08:00 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:08:00 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:08:00 user devstack@n-api.service[61645]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:08:00 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:08:00 user devstack@n-api.service[61645]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:08:00 user devstack@n-api.service[61645]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:08:00 user devstack@n-api.service[61645]: method: > Apr 14 06:08:00 user devstack@n-api.service[61645]: exception: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61645]: action_args: {'id': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'} Apr 14 06:08:00 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:08:00 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3da58c32-6693-4932-b37b-98550ea01eb4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 404 len: 111 microversion: 2.1 time: 0.031513 Apr 14 06:08:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 277/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:08:00 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-208869714"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1316450739", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "120654f0-7376-4b69-9763-9e1631a23590"}], "security_groups": [{"name": "tempest-securitygroup--1087363977"}], "key_name": "tempest-keypair-1592565508", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] validate_networks() for [('120654f0-7376-4b69-9763-9e1631a23590', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:08:00 user devstack@n-api.service[61644]: INFO nova.network.security_group_api [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Removing security group 00210d38-a241-4c48-b457-19b96a0929b1 from port 5803dbac-c755-47eb-93a1-ff9e122638f9 Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e37e9653-40f7-4eec-93f0-6b3835563535 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action" status: 202 len: 0 microversion: 2.1 time: 0.628900 Apr 14 06:08:00 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 277/825] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:08:00 2023] POST /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:08:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:08:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-913dcea4-b361-4161-9927-0a6503b1fb8f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.665165 Apr 14 06:08:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 272/826] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:08:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-87c66a2d-30b6-4ee7-8f7e-f31484debcee tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:00 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-87c66a2d-30b6-4ee7-8f7e-f31484debcee tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] Creating event network-changed:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:08:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-71abdeee-e59a-419b-bff3-377e45cb4a83 req-54f3c457-20fe-4a0c-a1c4-eca190ee0b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119123 Apr 14 06:08:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 278/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-87c66a2d-30b6-4ee7-8f7e-f31484debcee tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-87c66a2d-30b6-4ee7-8f7e-f31484debcee tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 200 len: 1233 microversion: 2.1 time: 0.090688 Apr 14 06:08:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 278/828] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:08:00 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:08:01 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:01 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] Creating event network-changed:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:08:01 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-971adecd-b992-4d70-8d53-750748377574 req-2ae45760-c7db-4eb3-beb1-2db8ef5f6c48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078608 Apr 14 06:08:01 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 273/829] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:01 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'services' on Instance uuid 03f4b70b-c32e-422c-856a-2edb0656df4b {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:08:01 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-15b60705-021a-45fe-863d-c9f81ede6028 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments/bfc58917-7df1-4372-b516-1afa6e0ad1bb" status: 202 len: 0 microversion: 2.1 time: 0.161449 Apr 14 06:08:01 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 279/830] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:08:01 2023] DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments/bfc58917-7df1-4372-b516-1afa6e0ad1bb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-6a3bc0ee-3fdb-490f-81a0-e2583240d717 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Apr 14 06:08:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 279/831] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:08:01 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] [instance: 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] HTTP exception thrown: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Request method failure captured: Apr 14 06:08:02 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf HTTP/1.1 Apr 14 06:08:02 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:08:02 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:08:02 user devstack@n-api.service[61646]: Connection: close Apr 14 06:08:02 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:08:02 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:08:02 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:08:02 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:08:02 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOO0eSoaQUGQsRu1jvd6jMw0dSYiWzasjzpC58VDwzl0pe1MHr_8i7yy1SO9VCRt6ONh_eB3A_caGCJwcBuekhPaW2KYxrb8OOaih5DW49WXc9EvfcClOHxp7moYXWKsVqwlMla8szfc6ics55VxfNQbnZaCZi4vnakiwZynD_AQy_TU Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Project-Id: 2da761d3e4e148b592b6edda8197ce00 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Project-Name: tempest-VolumesNegativeTest-678118524 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2da761d3e4e148b592b6edda8197ce00"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2da761d3e4e148b592b6edda8197ce00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2da761d3e4e148b592b6edda8197ce00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Tenant: tempest-VolumesNegativeTest-678118524 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Tenant-Id: 2da761d3e4e148b592b6edda8197ce00 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-VolumesNegativeTest-678118524 Apr 14 06:08:02 user devstack@n-api.service[61646]: X-User: tempest-VolumesNegativeTest-678118524-project-member Apr 14 06:08:02 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:08:02 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:08:02 user devstack@n-api.service[61646]: X-User-Id: a6991107308f4db89290f32efd2ac63e Apr 14 06:08:02 user devstack@n-api.service[61646]: X-User-Name: tempest-VolumesNegativeTest-678118524-project-member Apr 14 06:08:02 user devstack@n-api.service[61646]: method: > Apr 14 06:08:02 user devstack@n-api.service[61646]: exception: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. Apr 14 06:08:02 user devstack@n-api.service[61646]: action_args: {'id': '6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf'} Apr 14 06:08:02 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. Apr 14 06:08:02 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] Returning 404 to user: Instance 6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3edb4f36-818e-4ca8-800f-8166b2353797 tempest-VolumesNegativeTest-678118524 tempest-VolumesNegativeTest-678118524-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf" status: 404 len: 111 microversion: 2.1 time: 0.038831 Apr 14 06:08:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 274/832] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:08:02 2023] GET /compute/v2.1/servers/6d39d187-bdb9-4011-a7b9-8bcd3e99f9bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lazy-loading 'services' on Instance uuid 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:08:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5bcc10ee-4d02-4c53-a994-23b39cc2f424 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/54d090c3-2714-4bf5-9b41-58a1b7420b84" status: 202 len: 0 microversion: 2.1 time: 0.199371 Apr 14 06:08:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 280/833] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:08:02 2023] DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments/54d090c3-2714-4bf5-9b41-58a1b7420b84 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f46ed1f9-f0f6-42e0-893b-58c7b9e68f4c tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055160 Apr 14 06:08:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 280/834] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:08:02 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:03 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:03 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] Creating event network-changed:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:08:03 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-95589a2d-3648-43b4-91ef-c661bce44bb1 req-219cc9fc-73b8-49db-b386-4e89dbe7c00b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043488 Apr 14 06:08:03 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 275/835] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:08:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-3bac45a7-1f15-49de-a712-a7f9e46feaca req-57f82635-15b2-479f-b8ef-2f171417fc07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040581 Apr 14 06:08:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 281/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:08:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-197b92e8-ab20-4667-b309-d494b28dc8d6 req-eeaf1816-7518-4bfd-a79f-9df160c15b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Apr 14 06:08:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 281/837] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=16 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: e9f3555f-72fe-416f-8264-9c20053a00b0] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HTTP exception thrown: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Request method failure captured: Apr 14 06:08:28 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 HTTP/1.1 Apr 14 06:08:28 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:08:28 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:08:28 user devstack@n-api.service[61646]: Connection: close Apr 14 06:08:28 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:08:28 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:08:28 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:08:28 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:08:28 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOmrF6GLyVY1Hp8YwvkzyCSLI-Q-ie86KCrn7iqNfDT4DGCpmHsR2wV4uDJOka-YevvbyuZi6FKYFvUm189qLPRdDBqDFEpK_vlwflqzaqgbPt85eRPJ_pwaJegCodOnuMetJLeZf5uG-xkp5Gms6FxHtfVydit-nyso3eoEgO0OlVE Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Project-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Tenant-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:08:28 user devstack@n-api.service[61646]: X-User: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:08:28 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:08:28 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:08:28 user devstack@n-api.service[61646]: X-User-Id: c4946885e01a4f0da206d796027b3c9f Apr 14 06:08:28 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:08:28 user devstack@n-api.service[61646]: method: > Apr 14 06:08:28 user devstack@n-api.service[61646]: exception: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. Apr 14 06:08:28 user devstack@n-api.service[61646]: action_args: {'id': 'e9f3555f-72fe-416f-8264-9c20053a00b0'} Apr 14 06:08:28 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. Apr 14 06:08:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:08:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Returning 404 to user: Instance e9f3555f-72fe-416f-8264-9c20053a00b0 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-994e437d-de0f-434e-9484-db625fe4c6e1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0" status: 404 len: 111 microversion: 2.87 time: 0.044273 Apr 14 06:08:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 276/838] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:08:28 2023] GET /compute/v2.1/servers/e9f3555f-72fe-416f-8264-9c20053a00b0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=12 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:29 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:08:29 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-77fb7a9c-8d1f-48ea-9246-6366ff9998af tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 204 len: 0 microversion: 2.87 time: 0.240206 Apr 14 06:08:29 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 282/839] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:08:29 2023] DELETE /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=14 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=20 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:29 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f7fbc135-bd72-41ce-b446-e6389521d63a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 200 len: 1697 microversion: 2.87 time: 0.258877 Apr 14 06:08:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 282/840] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:08:29 2023] GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 1697 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:08:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "name": "network-vif-unplugged", "status": "completed", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] Creating event network-vif-unplugged:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 06:08:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-18ebf194-4b13-4cd4-8190-989a8f686c7d req-72b096ad-9b0b-4a3c-9d16-5f8822105e66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028668 Apr 14 06:08:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 277/841] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "name": "network-vif-plugged", "status": "completed", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}, {"server_uuid": "909d40f9-ca97-4a34-bd3e-f9c98b27a963", "name": "network-vif-deleted", "tag": "b9ba85e5-aaf3-43c4-a3ed-241516556ced"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Creating event network-vif-plugged:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 06:08:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] Creating event network-vif-deleted:b9ba85e5-aaf3-43c4-a3ed-241516556ced for instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 on user Apr 14 06:08:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-ec798b57-a300-4639-b854-51ba9a78441e req-716eaeca-ee5e-44d4-bcaa-47eb21e1f0d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032951 Apr 14 06:08:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 283/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:51 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4cc28768-83ba-40f8-bbae-5d445c9995d6 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 200 len: 1540 microversion: 2.1 time: 0.147007 Apr 14 06:08:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 283/843] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:08:51 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 1540 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:08:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:51 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 753, in _finalize_fairy Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 1004, in _reset Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/engine/default.py", line 683, in do_rollback Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/pymysql/connections.py", line 482, in rollback Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/pymysql/connections.py", line 442, in _read_ok_packet Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/pymysql/connections.py", line 696, in _read_packet Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/pymysql/connections.py", line 736, in _read_bytes Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.10/socket.py", line 705, in readinto Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Apr 14 06:08:52 user devstack@n-api.service[61646]: ERROR sqlalchemy.pool.impl.QueuePool Apr 14 06:08:52 user devstack@n-api.service[61646]: Exception ignored in: . at 0x7f55e28e7640> Apr 14 06:08:52 user devstack@n-api.service[61646]: Traceback (most recent call last): Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 498, in Apr 14 06:08:52 user devstack@n-api.service[61646]: and _finalize_fairy(None, rec, pool, ref, echo, True), Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 790, in _finalize_fairy Apr 14 06:08:52 user devstack@n-api.service[61646]: connection_record.checkin() Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 531, in checkin Apr 14 06:08:52 user devstack@n-api.service[61646]: pool.dispatch.checkin(connection, self) Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/event/attr.py", line 334, in __call__ Apr 14 06:08:52 user devstack@n-api.service[61646]: fn(*args, **kw) Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Apr 14 06:08:52 user devstack@n-api.service[61646]: time.sleep(0) Apr 14 06:08:52 user devstack@n-api.service[61646]: File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 33, in sleep Apr 14 06:08:52 user devstack@n-api.service[61646]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Apr 14 06:08:52 user devstack@n-api.service[61646]: AssertionError: do not call blocking functions from the mainloop Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5ef937ae-cacf-4313-beea-cb4bfef0fa4a tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086111 Apr 14 06:08:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 278/844] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:08:51 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HTTP exception thrown: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b is not attached to volume bfc58917-7df1-4372-b516-1afa6e0ad1bb Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Request method failure captured: Apr 14 06:08:52 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments/bfc58917-7df1-4372-b516-1afa6e0ad1bb HTTP/1.1 Apr 14 06:08:52 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:08:52 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:08:52 user devstack@n-api.service[61645]: Connection: close Apr 14 06:08:52 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:08:52 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:08:52 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:08:52 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:08:52 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOzDy47mQujf4UuAZN-PxgcsIBQ2D08VBK4w1rtnwav23pqVprrN4O3cE14DVUDmXN40IFut-sXARhmB_4cNB56ibhJflY_lDgkgpLfLDsxqIJz0_lyworeQuiwa3zbMhEbouYSbgT1IJ3kyOejLA5uNwUdKLZ4UHCX8daDp1GbxRY4 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Project-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Tenant: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Tenant-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-User: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:08:52 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:08:52 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:08:52 user devstack@n-api.service[61645]: X-User-Id: b59b8f9b395149c7a2eef067766f0935 Apr 14 06:08:52 user devstack@n-api.service[61645]: X-User-Name: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:08:52 user devstack@n-api.service[61645]: method: > Apr 14 06:08:52 user devstack@n-api.service[61645]: exception: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b is not attached to volume bfc58917-7df1-4372-b516-1afa6e0ad1bb Apr 14 06:08:52 user devstack@n-api.service[61645]: action_args: {'server_id': '03f4b70b-c32e-422c-856a-2edb0656df4b', 'id': 'bfc58917-7df1-4372-b516-1afa6e0ad1bb'} Apr 14 06:08:52 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bfc58917-7df1-4372-b516-1afa6e0ad1bb. Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b is not attached to volume bfc58917-7df1-4372-b516-1afa6e0ad1bb Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b is not attached to volume bfc58917-7df1-4372-b516-1afa6e0ad1bb Apr 14 06:08:52 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:08:52 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Returning 404 to user: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b is not attached to volume bfc58917-7df1-4372-b516-1afa6e0ad1bb {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:08:52 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e18a3414-d445-4c13-93bc-ecbe7ad162d0 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments/bfc58917-7df1-4372-b516-1afa6e0ad1bb" status: 404 len: 154 microversion: 2.1 time: 0.111881 Apr 14 06:08:52 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 284/845] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:08:52 2023] DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b/os-volume_attachments/bfc58917-7df1-4372-b516-1afa6e0ad1bb => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:53 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:53 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-28a8323c-7f6f-40a1-b49c-98452b0e93c9 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040131 Apr 14 06:08:53 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 284/846] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:08:53 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:55 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:08:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-37ea9b99-9ff7-4e5c-b96c-c0f7e530643b tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 204 len: 0 microversion: 2.1 time: 0.145786 Apr 14 06:08:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 279/847] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:08:55 2023] DELETE /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:55 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:08:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-cee3814d-302c-4988-a738-6f6b446b733e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 200 len: 1541 microversion: 2.1 time: 0.197055 Apr 14 06:08:56 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 285/848] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:08:55 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 1541 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:08:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-unplugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] Creating event network-vif-unplugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:08:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-31ec9e4c-455f-4af0-8621-e212eee5416e req-cd5a4968-71c4-43ab-a539-ea11b3047723 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029678 Apr 14 06:08:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 285/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:57 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-deleted", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] Creating event network-vif-deleted:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:08:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-d94b08c4-c740-44c6-b82c-675298cb8ac0 req-fff2ebfe-70b0-4e32-b535-d93cf8efaa9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029103 Apr 14 06:08:57 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 280/850] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:08:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f4b70b-c32e-422c-856a-2edb0656df4b", "name": "network-vif-plugged", "status": "completed", "tag": "5803dbac-c755-47eb-93a1-ff9e122638f9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:08:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:08:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:08:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:08:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] Creating event network-vif-plugged:5803dbac-c755-47eb-93a1-ff9e122638f9 for instance 03f4b70b-c32e-422c-856a-2edb0656df4b on user Apr 14 06:08:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-df0d926a-d1a9-4bd9-a4ee-d294a7ccf2d1 req-af461de0-142a-4504-b1dc-bac417969208 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031199 Apr 14 06:08:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 286/851] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=14 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:13 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] Creating event network-changed:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:09:13 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-5806496e-5a91-4362-84c8-29eef38f5054 req-0ea5df67-377c-4e9a-b205-0ca5ba86464a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054916 Apr 14 06:09:13 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 286/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:16 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:09:16 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d4acdc03-8e82-43c2-b4a8-ccac79b7153f tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 204 len: 0 microversion: 2.1 time: 0.137159 Apr 14 06:09:16 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 281/853] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:09:16 2023] DELETE /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=14 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:17 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44c8bc2bd90742dab8b74d340bd9d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ed03c728ca4f37b84f644a501f3f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:17 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9ec13986-faca-4156-b81e-7c243b244a2d tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 200 len: 1572 microversion: 2.1 time: 0.256327 Apr 14 06:09:17 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 287/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:09:16 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 1572 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:09:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "name": "network-vif-unplugged", "status": "completed", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] Creating event network-vif-unplugged:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:09:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-12f6c7b9-e992-47f7-a6d7-e0164f869830 req-3b7d993c-8ea7-4a6f-9ac9-b1ed9dfe3d10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031243 Apr 14 06:09:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 287/855] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "name": "network-vif-deleted", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] Creating event network-vif-deleted:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:09:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-5b2fbbd5-1faf-4397-9a1c-d40fae4b2963 req-71624446-80dc-4964-b212-d38ce2ad537a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032407 Apr 14 06:09:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 282/856] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3", "name": "network-vif-plugged", "status": "completed", "tag": "6fa2ad6f-43e9-42a0-961b-5b0b3af834fa"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] Creating event network-vif-plugged:6fa2ad6f-43e9-42a0-961b-5b0b3af834fa for instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 on user Apr 14 06:09:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-9e566530-e3a2-4ca9-b480-5ee4c5ee1584 req-66938941-40a8-4e1a-85e4-8036a37bdbdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028457 Apr 14 06:09:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 288/857] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 909d40f9-ca97-4a34-bd3e-f9c98b27a963] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HTTP exception thrown: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Request method failure captured: Apr 14 06:09:19 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 HTTP/1.1 Apr 14 06:09:19 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:09:19 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:09:19 user devstack@n-api.service[61644]: Connection: close Apr 14 06:09:19 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:09:19 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:09:19 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:09:19 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:09:19 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmrF6GLyVY1Hp8YwvkzyCSLI-Q-ie86KCrn7iqNfDT4DGCpmHsR2wV4uDJOka-YevvbyuZi6FKYFvUm189qLPRdDBqDFEpK_vlwflqzaqgbPt85eRPJ_pwaJegCodOnuMetJLeZf5uG-xkp5Gms6FxHtfVydit-nyso3eoEgO0OlVE Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Project-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Tenant-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:09:19 user devstack@n-api.service[61644]: X-User: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:09:19 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:09:19 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:09:19 user devstack@n-api.service[61644]: X-User-Id: c4946885e01a4f0da206d796027b3c9f Apr 14 06:09:19 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:09:19 user devstack@n-api.service[61644]: method: > Apr 14 06:09:19 user devstack@n-api.service[61644]: exception: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. Apr 14 06:09:19 user devstack@n-api.service[61644]: action_args: {'id': '909d40f9-ca97-4a34-bd3e-f9c98b27a963'} Apr 14 06:09:19 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. Apr 14 06:09:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Returning 404 to user: Instance 909d40f9-ca97-4a34-bd3e-f9c98b27a963 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:09:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ae66b7f5-4502-4593-94d6-29929d78bbe1 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963" status: 404 len: 111 microversion: 2.87 time: 0.031888 Apr 14 06:09:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 288/858] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:09:19 2023] GET /compute/v2.1/servers/909d40f9-ca97-4a34-bd3e-f9c98b27a963 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:09:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7ca99a06-2087-4b0c-b824-ee0f817f7542 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 204 len: 0 microversion: 2.87 time: 0.112813 Apr 14 06:09:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 283/859] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:09:19 2023] DELETE /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:20 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:20 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:20 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-da1cb067-5b5e-48e9-bbb7-bf6857426135 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 200 len: 1775 microversion: 2.87 time: 0.179335 Apr 14 06:09:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 289/860] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:09:19 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 1775 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 06:09:20 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-unplugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] Creating event network-vif-unplugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 06:09:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-d95b0e49-5c7b-48a0-b497-bef934f75e81 req-793883a6-5a85-493b-a814-21d850d9fbb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066073 Apr 14 06:09:20 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 289/861] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:22 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-deleted", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] Creating event network-vif-deleted:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 06:09:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-aecbfade-f826-4248-931d-c0a88d3487af req-f5345842-5ddc-4db1-95b7-b757dd05c9f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035423 Apr 14 06:09:22 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 284/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:09:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ae7eba-11e8-4a56-b368-739848ed9dbc", "name": "network-vif-plugged", "status": "completed", "tag": "9dfcb341-1a5c-4661-8f34-e559acf931b9"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] Creating event network-vif-plugged:9dfcb341-1a5c-4661-8f34-e559acf931b9 for instance 46ae7eba-11e8-4a56-b368-739848ed9dbc on user Apr 14 06:09:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-bc0e2468-715a-4576-ad43-b88daeab5ed3 req-6f65f275-7cbc-4e14-9b2c-c480b0b0dded service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029017 Apr 14 06:09:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 290/863] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 03f4b70b-c32e-422c-856a-2edb0656df4b] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HTTP exception thrown: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Request method failure captured: Apr 14 06:09:46 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b HTTP/1.1 Apr 14 06:09:46 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:09:46 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:09:46 user devstack@n-api.service[61644]: Connection: close Apr 14 06:09:46 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:09:46 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:09:46 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:09:46 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:09:46 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOzDy47mQujf4UuAZN-PxgcsIBQ2D08VBK4w1rtnwav23pqVprrN4O3cE14DVUDmXN40IFut-sXARhmB_4cNB56ibhJflY_lDgkgpLfLDsxqIJz0_lyworeQuiwa3zbMhEbouYSbgT1IJ3kyOejLA5uNwUdKLZ4UHCX8daDp1GbxRY4 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Project-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Tenant: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Tenant-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-User: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:09:46 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:09:46 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:09:46 user devstack@n-api.service[61644]: X-User-Id: b59b8f9b395149c7a2eef067766f0935 Apr 14 06:09:46 user devstack@n-api.service[61644]: X-User-Name: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:09:46 user devstack@n-api.service[61644]: method: > Apr 14 06:09:46 user devstack@n-api.service[61644]: exception: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. Apr 14 06:09:46 user devstack@n-api.service[61644]: action_args: {'id': '03f4b70b-c32e-422c-856a-2edb0656df4b'} Apr 14 06:09:46 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. Apr 14 06:09:46 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:09:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Returning 404 to user: Instance 03f4b70b-c32e-422c-856a-2edb0656df4b could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:09:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1dfa136d-b96e-4a38-b4e9-5e057522e2ab tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b" status: 404 len: 111 microversion: 2.1 time: 0.061802 Apr 14 06:09:46 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 290/864] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:09:46 2023] GET /compute/v2.1/servers/03f4b70b-c32e-422c-856a-2edb0656df4b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:09:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-46168e42-662f-4d3b-9f0c-596c543f6b6d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '.version_select at 0x7f55e28e6b90>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:46 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-46168e42-662f-4d3b-9f0c-596c543f6b6d tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231549131" status: 202 len: 0 microversion: 2.1 time: 0.032140 Apr 14 06:09:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 285/865] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 06:09:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231549131 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:09:48 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e1f0586d-6c81-42a4-bd19-977284f45d4c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: .version_select at 0x7f55e29cd090>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-837934314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6717EzUGPxpTDGefgn7rftigYth+LN1b3MDw9UEhO4TFyX7K4H3Y2IEbim4etXBQkV03TLTzHm/4DHGPKSs7S1l1Q1oGMK8FZaaRruTC6RsXI+5MtzYR1tXUiaq7CGuQ=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:48 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:48 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=16 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:48 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-e1f0586d-6c81-42a4-bd19-977284f45d4c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:09:48 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-e1f0586d-6c81-42a4-bd19-977284f45d4c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for user b59b8f9b395149c7a2eef067766f0935 and project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:09:48 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e1f0586d-6c81-42a4-bd19-977284f45d4c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053627 Apr 14 06:09:48 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 291/866] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:09:48 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-490473571", "imageRef": "2b01c0ae-81f1-467e-b60a-a042f9451f03", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-837934314", "networks": [{"uuid": "bbe6141e-3cce-47df-aec9-bf81eb18830c"}]}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:48 user devstack@n-api.service[61644]: DEBUG nova.network.neutron [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] validate_networks() for [('bbe6141e-3cce-47df-aec9-bf81eb18830c', None, None, None, None, None)] {{(pid=61644) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image limits 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Flavor pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Image pref 0:0:0 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.virt.hardware [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61644) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Getting quotas for user b59b8f9b395149c7a2eef067766f0935 and project 7a4e84122c3c4cb68c55043fd3c4db35. Resources: {'ram', 'cores', 'instances'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Going to run 1 instances... {{(pid=61644) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:09:49 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2b01c0ae-81f1-467e-b60a-a042f9451f03',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61644) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:09:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a5db5eb8-9bb9-4b86-91f3-a81315bf2977 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.681320 Apr 14 06:09:49 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 291/867] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:09:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:09:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0b86fdf2-8cb0-41ba-839a-75aef1780598 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:49 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0b86fdf2-8cb0-41ba-839a-75aef1780598 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:49 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-0b86fdf2-8cb0-41ba-839a-75aef1780598 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0b86fdf2-8cb0-41ba-839a-75aef1780598 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1251 microversion: 2.1 time: 0.077419 Apr 14 06:09:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 286/868] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:09:49 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1251 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:09:51 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:51 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:51 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] Creating event network-changed:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:09:51 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-89709403-8594-4498-aa3f-15ba4d670063 req-9368d37e-00c7-4fed-a482-b4d3727a271e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034287 Apr 14 06:09:51 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 292/869] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:51 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6d46c637-f6e5-4a96-abdd-d43db08f47b2 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.438885 Apr 14 06:09:51 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 292/870] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:09:51 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c/os-interface => generated 282 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:52 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:52 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] Creating event network-changed:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:09:52 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-7991d8f7-ff1f-4167-bc61-61e714a023c6 req-5604ee14-e6a2-4049-9ac8-b3fc7ae3c639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030330 Apr 14 06:09:52 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 287/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:09:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:09:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-c35a4c48-2eea-49a5-ba0e-058d80408070 req-9197768f-c528-496a-a70c-e95027a9e5a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053091 Apr 14 06:09:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 293/872] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:56 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:56 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:09:56 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-cdeca90c-2178-4579-888c-82480ac58f00 req-70d15057-30a5-4cc7-a730-088f671855b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 Apr 14 06:09:56 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 293/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:09:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1934317016", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "120654f0-7376-4b69-9763-9e1631a23590"}], "security_groups": [{"name": "tempest-securitygroup--1087363977"}], "key_name": "tempest-keypair-1592565508", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "e98f1b81-0e6e-43f4-ae89-22875745113b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:56 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] validate_networks() for [('120654f0-7376-4b69-9763-9e1631a23590', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:09:57 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e98f1b81-0e6e-43f4-ae89-22875745113b',volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:09:57 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-49378b89-e3df-41be-a2c0-71d979cbf1a4 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.093331 Apr 14 06:09:57 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 288/874] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:09:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:09:57 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-d24b9b1b-1ddb-4abe-a6d3-e81f651ee0e7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:09:57 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-d24b9b1b-1ddb-4abe-a6d3-e81f651ee0e7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:09:57 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-d24b9b1b-1ddb-4abe-a6d3-e81f651ee0e7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:09:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-d24b9b1b-1ddb-4abe-a6d3-e81f651ee0e7 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1076 microversion: 2.1 time: 0.065317 Apr 14 06:09:57 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 294/875] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:09:57 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1076 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:09:59 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:09:59 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:09:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:09:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:09:59 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:09:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] Creating event network-changed:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:09:59 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-04dfacf4-6264-4c8c-80e3-a5b3c8254c8d req-97221535-9d9b-4b25-a2b2-651c82467857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046644 Apr 14 06:09:59 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 294/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:10:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:10:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-f9c57b4a-0fef-4fd5-9f67-bf33d8e5a089 req-8472f848-df25-412f-ac5b-21a08c71f97b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040611 Apr 14 06:10:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 289/877] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:10:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] [instance: 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] HTTP exception thrown: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Request method failure captured: Apr 14 06:10:07 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 HTTP/1.1 Apr 14 06:10:07 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:10:07 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:10:07 user devstack@n-api.service[61644]: Connection: close Apr 14 06:10:07 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:10:07 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:10:07 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:10:07 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:10:07 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOxzgHguGezwd69HunNnTzgdvoqFI2FGPLH6IX2Bf7K2_9MRG6V3PuZt1CU_blEkS0K3jMIW_rUxCftYNjP0iekRYJ3RIQLY94gbCHuiGQm5FGfL-f15v6qngdO7uz4L5fOFVqv-YrLxZF5hRL1s16yxTxZ799Ew-kpqTeBy7dr56Bw Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Project-Id: 95ed03c728ca4f37b84f644a501f3f85 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1995100522 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95ed03c728ca4f37b84f644a501f3f85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/95ed03c728ca4f37b84f644a501f3f85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/95ed03c728ca4f37b84f644a501f3f85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Tenant: tempest-SnapshotDataIntegrityTests-1995100522 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Tenant-Id: 95ed03c728ca4f37b84f644a501f3f85 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1995100522 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-User: tempest-SnapshotDataIntegrityTests-1995100522-project-member Apr 14 06:10:07 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:10:07 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:10:07 user devstack@n-api.service[61644]: X-User-Id: 44c8bc2bd90742dab8b74d340bd9d9b7 Apr 14 06:10:07 user devstack@n-api.service[61644]: X-User-Name: tempest-SnapshotDataIntegrityTests-1995100522-project-member Apr 14 06:10:07 user devstack@n-api.service[61644]: method: > Apr 14 06:10:07 user devstack@n-api.service[61644]: exception: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. Apr 14 06:10:07 user devstack@n-api.service[61644]: action_args: {'id': '21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3'} Apr 14 06:10:07 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. Apr 14 06:10:07 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Returning 404 to user: Instance 21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:10:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ab22613e-e13b-404f-a3a7-81c5ec73d1b8 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3" status: 404 len: 111 microversion: 2.1 time: 0.031829 Apr 14 06:10:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 295/878] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:10:07 2023] GET /compute/v2.1/servers/21ce9fa7-f2b6-4da9-8f5f-736b4f8527c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:10:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-577c6441-5dbe-451f-820e-bfc16eeee353 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] Calling method '.version_select at 0x7f55e29cfe20>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-577c6441-5dbe-451f-820e-bfc16eeee353 tempest-SnapshotDataIntegrityTests-1995100522 tempest-SnapshotDataIntegrityTests-1995100522-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-543536161" status: 202 len: 0 microversion: 2.1 time: 0.033593 Apr 14 06:10:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 295/879] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:10:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-543536161 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:10:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b0fefa7d-3c8f-4685-9df8-dec54b301c1e req-3ad3ec41-63b0-49ab-b382-afa0cd4d5844 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034191 Apr 14 06:10:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 290/880] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:10:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 46ae7eba-11e8-4a56-b368-739848ed9dbc] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HTTP exception thrown: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Request method failure captured: Apr 14 06:10:10 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc HTTP/1.1 Apr 14 06:10:10 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:10:10 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:10:10 user devstack@n-api.service[61644]: Connection: close Apr 14 06:10:10 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:10:10 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:10:10 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:10:10 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:10:10 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOmrF6GLyVY1Hp8YwvkzyCSLI-Q-ie86KCrn7iqNfDT4DGCpmHsR2wV4uDJOka-YevvbyuZi6FKYFvUm189qLPRdDBqDFEpK_vlwflqzaqgbPt85eRPJ_pwaJegCodOnuMetJLeZf5uG-xkp5Gms6FxHtfVydit-nyso3eoEgO0OlVE Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Project-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Tenant-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:10:10 user devstack@n-api.service[61644]: X-User: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:10:10 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:10:10 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:10:10 user devstack@n-api.service[61644]: X-User-Id: c4946885e01a4f0da206d796027b3c9f Apr 14 06:10:10 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:10:10 user devstack@n-api.service[61644]: method: > Apr 14 06:10:10 user devstack@n-api.service[61644]: exception: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. Apr 14 06:10:10 user devstack@n-api.service[61644]: action_args: {'id': '46ae7eba-11e8-4a56-b368-739848ed9dbc'} Apr 14 06:10:10 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. Apr 14 06:10:10 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:10:10 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Returning 404 to user: Instance 46ae7eba-11e8-4a56-b368-739848ed9dbc could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:10:10 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a218ce04-ca76-4023-af4e-b07a505b562d tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc" status: 404 len: 111 microversion: 2.87 time: 0.036632 Apr 14 06:10:10 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 296/881] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:10:10 2023] GET /compute/v2.1/servers/46ae7eba-11e8-4a56-b368-739848ed9dbc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:10:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-54ed5a54-dac0-486f-83c0-2d6df2b9d1fc tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 204 len: 0 microversion: 2.87 time: 0.130813 Apr 14 06:10:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 296/882] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 06:10:10 2023] DELETE /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:10:10 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4946885e01a4f0da206d796027b3c9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7034e2177823496a861a1601a5c06fe4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:10:10 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b1364774-ca42-44bd-8e41-4c1f0da483b3 tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 200 len: 1697 microversion: 2.87 time: 0.212877 Apr 14 06:10:10 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 291/883] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:10:10 2023] GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 06:10:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "name": "network-vif-unplugged", "status": "completed", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:10:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] Creating event network-vif-unplugged:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 06:10:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-efb921d2-50c7-4b62-9f6c-9ee664e5a28f req-81a02817-eb76-492e-b175-02549de84271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044748 Apr 14 06:10:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 297/884] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "name": "network-vif-deleted", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:10:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] Creating event network-vif-deleted:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 06:10:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-cdb9cf32-990e-4698-b4c8-6e469518874a req-8739ae46-c684-4486-a7a3-707bf6b8a05e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032812 Apr 14 06:10:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 297/885] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c09efbc-4c94-4130-a927-9239420b7d37", "name": "network-vif-plugged", "status": "completed", "tag": "056b7c6a-6fa1-4a4a-ba45-3084cfc33643"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:10:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] Creating event network-vif-plugged:056b7c6a-6fa1-4a4a-ba45-3084cfc33643 for instance 5c09efbc-4c94-4130-a927-9239420b7d37 on user Apr 14 06:10:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-dbb09292-a28a-458d-8c99-b3f5178fbd3c req-113134ee-7a66-4f56-a654-40dc9ff89c17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028215 Apr 14 06:10:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 292/886] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:10:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:39 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:10:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7b3b52ff-304f-4302-8ee9-c93d9a841461 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1536 microversion: 2.1 time: 0.164143 Apr 14 06:10:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 298/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:10:39 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1536 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:10:47 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:10:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-68b15704-8898-4f09-a4f5-be448499f3b8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1430 microversion: 2.1 time: 0.170804 Apr 14 06:10:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 298/888] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:10:47 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1430 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=16 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] [instance: 5c09efbc-4c94-4130-a927-9239420b7d37] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] HTTP exception thrown: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Request method failure captured: Apr 14 06:11:00 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 HTTP/1.1 Apr 14 06:11:00 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:11:00 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:11:00 user devstack@n-api.service[61646]: Connection: close Apr 14 06:11:00 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:11:00 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:11:00 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:11:00 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:11:00 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOmrF6GLyVY1Hp8YwvkzyCSLI-Q-ie86KCrn7iqNfDT4DGCpmHsR2wV4uDJOka-YevvbyuZi6FKYFvUm189qLPRdDBqDFEpK_vlwflqzaqgbPt85eRPJ_pwaJegCodOnuMetJLeZf5uG-xkp5Gms6FxHtfVydit-nyso3eoEgO0OlVE Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Project-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7034e2177823496a861a1601a5c06fe4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Tenant-Id: 7034e2177823496a861a1601a5c06fe4 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711 Apr 14 06:11:00 user devstack@n-api.service[61646]: X-User: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:11:00 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:11:00 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:11:00 user devstack@n-api.service[61646]: X-User-Id: c4946885e01a4f0da206d796027b3c9f Apr 14 06:11:00 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member Apr 14 06:11:00 user devstack@n-api.service[61646]: method: > Apr 14 06:11:00 user devstack@n-api.service[61646]: exception: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. Apr 14 06:11:00 user devstack@n-api.service[61646]: action_args: {'id': '5c09efbc-4c94-4130-a927-9239420b7d37'} Apr 14 06:11:00 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. Apr 14 06:11:00 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:11:00 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] Returning 404 to user: Instance 5c09efbc-4c94-4130-a927-9239420b7d37 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:11:00 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-738a3a7b-9a9d-4be7-8a2f-96cc52ac5b5a tempest-ServerBootFromVolumeStableRescueTest-315541711 tempest-ServerBootFromVolumeStableRescueTest-315541711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37" status: 404 len: 111 microversion: 2.87 time: 0.054945 Apr 14 06:11:00 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 293/889] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 06:11:00 2023] GET /compute/v2.1/servers/5c09efbc-4c94-4130-a927-9239420b7d37 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:11:11 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:11 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-42fc6518-06fc-4b18-aff7-056e81edd3e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: .version_select at 0x7f55c86bbf40>, body: {"keypair": {"name": "tempest-keypair-1140459230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6TF+Zg8ftP47ylXb1K6XxWAu4TjAIiWKAEJPZubTTV6Po1otD7NtEzR0XXRZ+xy6RMchrhrvyJqfpCw1RQiMKvQ71lI2KS+6GWglZOJBgoHB+VsSVOJvbvbgum5X9zjQ=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:11 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-42fc6518-06fc-4b18-aff7-056e81edd3e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:11:11 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-42fc6518-06fc-4b18-aff7-056e81edd3e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:11:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-42fc6518-06fc-4b18-aff7-056e81edd3e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159726 Apr 14 06:11:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 299/890] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:11:11 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028846765", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848"}], "security_groups": [{"name": "tempest-securitygroup--425774775"}], "key_name": "tempest-keypair-1140459230", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:13 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:13 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:13 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] validate_networks() for [('45c8f442-1ff6-4f22-99ec-a3d77b4ba848', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:11:14 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:11:14 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-793a2b59-c7ac-4639-bf0b-37f3fee383ca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.168262 Apr 14 06:11:14 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 299/891] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:11:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:11:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-99279a55-c46b-4c51-8a9b-737562d3e8f7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:14 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-99279a55-c46b-4c51-8a9b-737562d3e8f7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:14 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-99279a55-c46b-4c51-8a9b-737562d3e8f7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-99279a55-c46b-4c51-8a9b-737562d3e8f7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 200 len: 1236 microversion: 2.1 time: 0.077088 Apr 14 06:11:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 294/892] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:14 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 1236 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:11:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:16 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] Creating event network-changed:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:11:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7df7dec4-d6ff-4f29-8fad-ace3f43bf492 req-7541e98f-ea0c-43c6-89c6-80fe17a679b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Apr 14 06:11:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "name": "network-vif-plugged", "status": "completed", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] Creating event network-vif-plugged:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:11:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-44e61022-814c-4bb4-b9d0-8e0bbea22e16 req-29b33b43-6bd9-44ed-8303-578d429f77bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045185 Apr 14 06:11:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 300/894] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:20 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "name": "network-vif-plugged", "status": "completed", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:20 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] Creating event network-vif-plugged:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:11:20 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-b158bf16-8ebe-4953-a74d-00c42e12d29e req-ef79ba63-e736-4a1a-be13-ca689a4a9b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031618 Apr 14 06:11:20 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 295/895] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:39 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-827b8a19-19a3-4f46-8b31-be50a2b59dd4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1536 microversion: 2.1 time: 0.154487 Apr 14 06:11:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 301/896] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:39 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1536 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Searching by: {'deleted': False, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35'} {{(pid=61645) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:39 user devstack@n-api.service[61645]: DEBUG nova.compute.multi_cell_list [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61645) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 06:11:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-997ec8e4-72b6-48fb-8810-418e47efced5 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.086757 Apr 14 06:11:39 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 301/897] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 06:11:39 2023] GET /compute/v2.1/servers => generated 340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:40 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a924a825-864f-4176-a0b5-4c641ad5bac4 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1536 microversion: 2.1 time: 0.156189 Apr 14 06:11:40 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 296/898] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:39 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1536 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa1963a-1093-4d62-9995-c005329e90ca"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:42 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:42 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-79e6632d-2070-43fd-8753-af23d0a9bc9f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281045 Apr 14 06:11:42 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 302/899] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:11:42 2023] POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ec7ce7da-262f-4a45-b7b8-0a049e763a6d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.093475 Apr 14 06:11:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 302/900] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:11:47 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:48 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:48 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:48 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] Creating event network-changed:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:11:48 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-2e1cc91b-85af-40ff-8c03-c3c3f0fd7ad9 req-465634ab-212c-4232-8abe-8c4d4be175c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034299 Apr 14 06:11:48 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 297/901] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:48 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b7635407-c8b0-4bee-ac85-bc983da726f3 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1430 microversion: 2.1 time: 0.304014 Apr 14 06:11:49 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 303/902] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:48 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1430 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Old instance type m1.nano, new instance type m1.micro {{(pid=61645) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Getting quotas for user 290b67b22a91443fbfc829fa4e3db036 and project dbc4321a7868464faa59341018ed747f. Resources: {'ram', 'cores'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:11:49 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:11:49 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-0c6e9e2c-b1aa-48ef-998d-9cd513967944 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action" status: 202 len: 0 microversion: 2.1 time: 0.181586 Apr 14 06:11:49 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 303/903] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:11:49 2023] POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:49 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-75788725-429a-45b8-9c22-6c7e40dc5d54 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1439 microversion: 2.1 time: 0.157773 Apr 14 06:11:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 298/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:49 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1439 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:50 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:50 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-3f48416d-6815-425e-a8bd-9cc708b5124f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1582 microversion: 2.1 time: 0.206947 Apr 14 06:11:50 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 304/905] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:50 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1582 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:50 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:50 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Creating event network-changed:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:11:50 user devstack@n-api.service[61645]: DEBUG nova.compute.api [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61645) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:11:50 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-d78c936e-7d1d-4549-9e3c-1e8de4c26800 req-50ee02aa-dfec-4ba1-b0d3-ed16cc51f998 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037827 Apr 14 06:11:50 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 304/906] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-unplugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Creating event network-vif-unplugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:11:51 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:11:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-cd027e3b-30bf-4faa-a6c4-b2bdac203fe3 req-3ac96fb1-8777-4b55-b2a8-0ce378cbd286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103776 Apr 14 06:11:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 299/907] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] Creating event network-changed:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:11:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f45e269d-16c1-4f60-bde0-28342cff1361 req-861893e2-f456-4bae-a9ca-bf0ffda3158d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034376 Apr 14 06:11:52 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 305/908] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-64167599"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:53 user devstack@n-api.service[61645]: INFO nova.network.security_group_api [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Adding security group 309703cf-def3-428d-93c9-ff7946f80d2f to port e9e38732-b365-4366-9985-4bd8392b49a2 Apr 14 06:11:53 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:53 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:53 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:53 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:11:53 user devstack@n-api.service[61646]: DEBUG nova.compute.api [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61646) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:11:53 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-3110a0c8-c70c-40fd-a87a-d19f82e22db4 req-f371cc1c-9b29-42fa-9ceb-42ee46134f15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041325 Apr 14 06:11:53 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 300/909] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-1ca12db2-04e1-44ea-8b1a-59153a631a17 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action" status: 202 len: 0 microversion: 2.1 time: 0.606342 Apr 14 06:11:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 305/910] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:11:53 2023] POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:54 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-eae84bbc-1000-4781-a1f4-898e15e385de tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1746 microversion: 2.1 time: 0.254618 Apr 14 06:11:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 306/911] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:54 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1746 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-5bddb178-6f76-46f1-9491-9f585bd0f26f tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action" status: 202 len: 0 microversion: 2.1 time: 0.444868 Apr 14 06:11:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 301/912] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:11:54 2023] POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:55 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:11:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7f184e32-e123-4a16-8e89-7f18fd9cb585 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1738 microversion: 2.1 time: 0.188659 Apr 14 06:11:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 306/913] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:11:55 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:11:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] Creating event network-changed:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:11:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-888a947c-239a-415c-bd77-b5b644ee78b9 req-d8c8c846-3f28-4e34-84e2-f803a4501b95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Apr 14 06:11:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 307/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:11:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:11:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:11:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:11:58 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:11:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] Creating event network-vif-unplugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:11:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ec2730aa-6fd1-4258-82ad-a976d011206e req-3097718f-e427-4801-a38b-c13e0e38ab0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027634 Apr 14 06:11:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 302/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:11:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:12:00 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:12:00 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=5 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:12:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:00 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:12:00 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-f3c62b40-f778-41f8-b8f4-7f59c27be31f req-481de825-4cbe-430d-a6f8-75ce83dbc0c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050010 Apr 14 06:12:00 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 307/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:12:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:12:02 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:12:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}, {"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:12:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:02 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:12:02 user devstack@n-api.service[61644]: DEBUG nova.compute.api [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61644) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:12:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:12:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:12:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-41e17eee-48c6-4f83-a10f-d416102745d7 req-8d8e1b4d-ddc0-43dc-a179-a3951b964146 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048670 Apr 14 06:12:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 308/917] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:12:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:12:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-7b78a683-a9fc-46bd-9f0a-fb4aa6354f6c req-58642a58-9d2e-4ab5-b156-fd2a9e105778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033418 Apr 14 06:12:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 303/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:12:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:12:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:12:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:12:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] Instance 216d6140-f106-4928-aa06-bc2d9e860f32 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61645) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 06:12:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-1eeaae6f-0db6-418f-9f45-d324b463ddfa req-8221edfc-2408-4339-9613-55b0dc6a6383 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040002 Apr 14 06:12:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 308/919] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:12:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:04 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:12:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5453300d-f5c1-42af-8b76-07f07d8781ba tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 200 len: 1545 microversion: 2.1 time: 0.250386 Apr 14 06:12:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 309/920] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:12:04 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 1545 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=16 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:39 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:12:39 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-0c0eb847-55f4-467b-9d49-efa1bfa56621 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1556 microversion: 2.1 time: 0.252822 Apr 14 06:12:39 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 304/921] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:12:39 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1556 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=28 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:12:45 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:12:45 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-29cd8f3c-5d68-44d2-a25f-3f293ad76649 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1746 microversion: 2.1 time: 0.182561 Apr 14 06:12:45 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 309/922] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:12:45 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=18 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:04 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:04 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ed5a112f-49d7-4d43-850d-07b0328e2d3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.151226 Apr 14 06:13:04 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 310/923] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:13:04 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-interface => generated 283 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:05 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] Creating event network-changed:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:13:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-809ccdab-09b7-474f-ad53-faa9f3c1b0be req-057f17c5-0bd7-418b-9683-cbe6d00f20fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083624 Apr 14 06:13:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 305/924] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:05 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d54fa741-0f12-401a-a3d5-e29f60e36e3e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/ips" status: 200 len: 108 microversion: 2.1 time: 0.047198 Apr 14 06:13:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 310/925] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:13:05 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/ips => generated 108 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e16793cd-59f8-4d57-a866-11ff27a42949"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-19d991c7-8f63-41c6-820d-2e00df0918db tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342517 Apr 14 06:13:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 311/926] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:13:07 2023] POST /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3a0ab229-fd46-484a-8fa0-81d294bc4aca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: .version_select at 0x7f55e28e5bd0>, body: {"keypair": {"name": "tempest-keypair-89290876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1l6C3lS7l3T0Kopj2frWcJGsvadIycSdD9s1243kRogCdFCXq3BLIe3Wh6LAy7Vm3sdaEvM60kvdGVCdwqBRX3H7IMY4npt430N8INv1HPDHGVPw70pQ52Bi7sD9MqUg=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:14 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-3a0ab229-fd46-484a-8fa0-81d294bc4aca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:13:14 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-3a0ab229-fd46-484a-8fa0-81d294bc4aca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:13:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3a0ab229-fd46-484a-8fa0-81d294bc4aca tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050508 Apr 14 06:13:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 306/927] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:13:14 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1054773517", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848"}], "security_groups": [{"name": "tempest-securitygroup--1884935531"}], "key_name": "tempest-keypair-89290876", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:15 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] validate_networks() for [('45c8f442-1ff6-4f22-99ec-a3d77b4ba848', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:13:15 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:13:16 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:13:16 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c5ce8e4c-9b53-4f2e-b46c-58274a0cf7be tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.595411 Apr 14 06:13:16 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 311/928] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:13:15 2023] POST /compute/v2.1/servers => generated 400 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:13:16 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-222fe7d4-fab0-425a-a9f7-84ca1265cb6e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:16 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-222fe7d4-fab0-425a-a9f7-84ca1265cb6e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:16 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-222fe7d4-fab0-425a-a9f7-84ca1265cb6e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:13:16 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-222fe7d4-fab0-425a-a9f7-84ca1265cb6e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 200 len: 1234 microversion: 2.1 time: 0.073299 Apr 14 06:13:16 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 312/929] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:13:16 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 1234 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:13:18 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] Creating event network-changed:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:13:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-15538f05-49d8-4c4e-abde-b346ade3ef8d req-c434c3df-b3be-42cd-a8af-37ecb3656ae6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031175 Apr 14 06:13:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 307/930] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:20 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "name": "network-vif-plugged", "status": "completed", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] Creating event network-vif-plugged:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:13:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-02d1dd19-e558-4fb5-b054-d42b707e9d16 req-799da0a5-96fc-4e5b-a3de-6af04ab6f929 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101765 Apr 14 06:13:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 312/931] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "name": "network-vif-plugged", "status": "completed", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:22 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] Creating event network-vif-plugged:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:13:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-eee076b4-d950-43d2-84e7-a072dd2d35e3 req-6af0a81c-f75a-477f-95cb-fdc035773f6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049960 Apr 14 06:13:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 313/932] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:39 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:39 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7f8d98f1-add6-4733-b470-dbf67ca249f8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action" status: 204 len: 0 microversion: 2.1 time: 0.076560 Apr 14 06:13:39 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 308/933] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:13:39 2023] POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:40 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:13:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a3498c22-d338-487b-beb1-167533e69ad8 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1556 microversion: 2.1 time: 0.171659 Apr 14 06:13:40 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 313/934] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:13:39 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-64167599"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:45 user devstack@n-api.service[61644]: INFO nova.network.security_group_api [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Removing security group 309703cf-def3-428d-93c9-ff7946f80d2f from port e9e38732-b365-4366-9985-4bd8392b49a2 Apr 14 06:13:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ecf3eb8d-00f0-4487-bd04-206c0b669d70 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action" status: 202 len: 0 microversion: 2.1 time: 0.600202 Apr 14 06:13:46 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 314/935] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:13:45 2023] POST /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:13:46 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:46 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] Creating event network-changed:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:13:46 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-6afa8662-0b08-49ec-91fc-c881001069c8 req-8cd682ba-c00f-48e1-b9a5-eacf9953e486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 Apr 14 06:13:46 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 309/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] Creating event network-changed:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:13:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-dd8b19a0-e01c-4ead-a27a-a157fd092844 req-6b20f4ed-7feb-4253-9eba-c446cdef15ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029983 Apr 14 06:13:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 315/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:13:47 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lazy-loading 'services' on Instance uuid 10c629c7-bbc9-4ddc-8284-64017419fada {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:13:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-90356cf1-ed02-47d8-bd6d-353025acf009 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments/1fa1963a-1093-4d62-9995-c005329e90ca" status: 202 len: 0 microversion: 2.1 time: 0.171062 Apr 14 06:13:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 314/938] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:13:47 2023] DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments/1fa1963a-1093-4d62-9995-c005329e90ca => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:13:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:13:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d56c154b-d6a4-42d9-92a5-31d93b9c0f51 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047439 Apr 14 06:13:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 310/939] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:13:47 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:06 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:14:06 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c71a1377-ab39-4f5a-b317-db3fc09af269 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 200 len: 1543 microversion: 2.1 time: 0.164777 Apr 14 06:14:06 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 316/940] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:14:06 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:30 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:14:30 user devstack@n-api.service[61645]: Fri Apr 14 06:14:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 (ip 10.0.0.210) !!! Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:30 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:14:30 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-49d242fd-9458-4cd9-87c0-5ac1eb96f097 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1548 microversion: 2.1 time: 0.242186 Apr 14 06:14:30 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 315/941] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:14:30 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1548 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fe7e8df4-7805-4216-9646-97f51ed8c3e3 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.185652 Apr 14 06:14:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 311/942] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:14:37 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HTTP exception thrown: Instance 10c629c7-bbc9-4ddc-8284-64017419fada is not attached to volume 1fa1963a-1093-4d62-9995-c005329e90ca Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Request method failure captured: Apr 14 06:14:37 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments/1fa1963a-1093-4d62-9995-c005329e90ca HTTP/1.1 Apr 14 06:14:37 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:14:37 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:14:37 user devstack@n-api.service[61644]: Connection: close Apr 14 06:14:37 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:14:37 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:14:37 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:14:37 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:14:37 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOzDy47mQujf4UuAZN-PxgcsIBQ2D08VBK4w1rtnwav23pqVprrN4O3cE14DVUDmXN40IFut-sXARhmB_4cNB56ibhJflY_lDgkgpLfLDsxqIJz0_lyworeQuiwa3zbMhEbouYSbgT1IJ3kyOejLA5uNwUdKLZ4UHCX8daDp1GbxRY4 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Project-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Project-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Tenant: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Tenant-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-User: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:14:37 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:14:37 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:14:37 user devstack@n-api.service[61644]: X-User-Id: b59b8f9b395149c7a2eef067766f0935 Apr 14 06:14:37 user devstack@n-api.service[61644]: X-User-Name: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:14:37 user devstack@n-api.service[61644]: method: > Apr 14 06:14:37 user devstack@n-api.service[61644]: exception: Instance 10c629c7-bbc9-4ddc-8284-64017419fada is not attached to volume 1fa1963a-1093-4d62-9995-c005329e90ca Apr 14 06:14:37 user devstack@n-api.service[61644]: action_args: {'server_id': '10c629c7-bbc9-4ddc-8284-64017419fada', 'id': '1fa1963a-1093-4d62-9995-c005329e90ca'} Apr 14 06:14:37 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1fa1963a-1093-4d62-9995-c005329e90ca. Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c629c7-bbc9-4ddc-8284-64017419fada is not attached to volume 1fa1963a-1093-4d62-9995-c005329e90ca Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c629c7-bbc9-4ddc-8284-64017419fada is not attached to volume 1fa1963a-1093-4d62-9995-c005329e90ca Apr 14 06:14:37 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:14:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Returning 404 to user: Instance 10c629c7-bbc9-4ddc-8284-64017419fada is not attached to volume 1fa1963a-1093-4d62-9995-c005329e90ca {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:14:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-ab21a8af-997d-460a-9ebe-c934b071e27c tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments/1fa1963a-1093-4d62-9995-c005329e90ca" status: 404 len: 154 microversion: 2.1 time: 0.107340 Apr 14 06:14:37 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 317/943] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:14:37 2023] DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada/os-volume_attachments/1fa1963a-1093-4d62-9995-c005329e90ca => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:40 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:14:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-bb867c7f-80cd-435c-8c3e-0fe32e04c9cf tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 204 len: 0 microversion: 2.1 time: 0.140177 Apr 14 06:14:41 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 316/944] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:14:40 2023] DELETE /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:41 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b59b8f9b395149c7a2eef067766f0935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4e84122c3c4cb68c55043fd3c4db35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:14:41 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-58fa4405-d727-42c1-9e6e-fb55acf95cc6 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 200 len: 1542 microversion: 2.1 time: 0.200077 Apr 14 06:14:41 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 312/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:14:41 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 1542 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:14:41 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-unplugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:14:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:41 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] Creating event network-vif-unplugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:41 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e7ea480f-9719-4a97-acd1-208bc8cf3983 req-79a9dc99-5c5d-4fd6-8eaf-3d286a5acac6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030302 Apr 14 06:14:41 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 318/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:14:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:14:43 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}, {"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}, {"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}, {"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-plugged", "status": "completed", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}, {"server_uuid": "10c629c7-bbc9-4ddc-8284-64017419fada", "name": "network-vif-deleted", "tag": "e9e38732-b365-4366-9985-4bd8392b49a2"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:14:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:14:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:14:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Creating event network-vif-plugged:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] Creating event network-vif-deleted:e9e38732-b365-4366-9985-4bd8392b49a2 for instance 10c629c7-bbc9-4ddc-8284-64017419fada on user Apr 14 06:14:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-a089614b-6f63-4e0c-b701-e41eb7d0a625 req-14e56c67-fe17-49b4-84d6-692979d08b1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.033752 Apr 14 06:14:43 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 317/947] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:14:43 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:06 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:06 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-39f93ee6-6b11-4a9a-b001-f7d7e1405282 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.097738 Apr 14 06:15:06 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 313/948] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:15:06 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/os-interface => generated 282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] Creating event network-changed:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:15:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-c30fcea7-f9cf-415e-bb03-e22e54f4add1 req-ddb144c9-1a75-4c09-98bb-0f03600336f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Apr 14 06:15:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 319/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7a643513-7610-4271-a457-df58f8272a44 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/ips" status: 200 len: 107 microversion: 2.1 time: 0.045403 Apr 14 06:15:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 318/950] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:15:07 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e16793cd-59f8-4d57-a866-11ff27a42949"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:15:07 user devstack@n-api.service[61646]: request: POST /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/os-volume_attachments HTTP/1.1 Apr 14 06:15:07 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:15:07 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:15:07 user devstack@n-api.service[61646]: Connection: close Apr 14 06:15:07 user devstack@n-api.service[61646]: Content-Length: 74 Apr 14 06:15:07 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:15:07 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:15:07 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:15:07 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:15:07 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:15:07 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:15:07 user devstack@n-api.service[61646]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:15:07 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:15:07 user devstack@n-api.service[61646]: Apr 14 06:15:07 user devstack@n-api.service[61646]: {"volumeAttachment": {"volumeId": "e16793cd-59f8-4d57-a866-11ff27a42949"}} Apr 14 06:15:07 user devstack@n-api.service[61646]: method: > Apr 14 06:15:07 user devstack@n-api.service[61646]: exception: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 Apr 14 06:15:07 user devstack@n-api.service[61646]: action_args: {'server_id': '0e5cb774-a032-4c16-86a4-e43d6b5d1d68', 'body': {'volumeAttachment': {'volumeId': 'e16793cd-59f8-4d57-a866-11ff27a42949'}}} Apr 14 06:15:07 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 Apr 14 06:15:07 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 400 to user: Invalid volume: volume e16793cd-59f8-4d57-a866-11ff27a42949 is already attached to instances: 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:15:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b29c6ee6-569f-4ad9-8cbe-8f97be686939 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104083 Apr 14 06:15:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 314/951] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:15:07 2023] POST /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:15:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8f7f314d-c023-44b7-8398-f5895f4ae34e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 204 len: 0 microversion: 2.1 time: 0.124568 Apr 14 06:15:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 320/952] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:15:07 2023] DELETE /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:15:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-782feecc-ca53-4b93-894a-7a06a2b1073f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 200 len: 1549 microversion: 2.1 time: 0.187502 Apr 14 06:15:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 319/953] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:15:07 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "name": "network-vif-unplugged", "status": "completed", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:07 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] Creating event network-vif-unplugged:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:15:07 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-45bf7a28-d416-4325-a42b-327ae1551f16 req-ee3e7eb5-143a-41d0-88db-730935ca2500 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029128 Apr 14 06:15:07 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 315/954] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:15:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "name": "network-vif-deleted", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] Creating event network-vif-deleted:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:15:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-8b5ffc17-1b58-44f4-85fb-8b1bf1c4e5bd req-fd66498a-1b14-4e52-9b85-83b2ae47cd75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028112 Apr 14 06:15:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 321/955] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:15:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:15:10 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5cb774-a032-4c16-86a4-e43d6b5d1d68", "name": "network-vif-plugged", "status": "completed", "tag": "c184c23c-ccfa-48d1-949c-3270c6443649"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:10 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] Creating event network-vif-plugged:c184c23c-ccfa-48d1-949c-3270c6443649 for instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 on user Apr 14 06:15:10 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-153d5635-1525-42b6-8347-7c1244a3145b req-9dce5d95-b6e3-4b32-84f8-d81335c3fcf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031701 Apr 14 06:15:10 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 320/956] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:30 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:15:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7a816822-eef0-405b-810d-7094b29f44aa tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1548 microversion: 2.1 time: 0.278171 Apr 14 06:15:30 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 316/957] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:15:30 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1548 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:30 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:30 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f04ae29d-b6a1-4074-a5c5-df505ed2d45f tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action" status: 200 len: 28314 microversion: 2.1 time: 0.245160 Apr 14 06:15:30 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 322/958] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:15:30 2023] POST /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32/action => generated 28314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=12 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:31 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:15:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8975b308-0f2e-444d-af1e-e8a47cabe044 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 200 len: 1540 microversion: 2.1 time: 0.149203 Apr 14 06:15:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 321/959] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:15:31 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 1540 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] [instance: 10c629c7-bbc9-4ddc-8284-64017419fada] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] HTTP exception thrown: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Request method failure captured: Apr 14 06:15:31 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada HTTP/1.1 Apr 14 06:15:31 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:15:31 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:15:31 user devstack@n-api.service[61646]: Connection: close Apr 14 06:15:31 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:15:31 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:15:31 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:15:31 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:15:31 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOzDy47mQujf4UuAZN-PxgcsIBQ2D08VBK4w1rtnwav23pqVprrN4O3cE14DVUDmXN40IFut-sXARhmB_4cNB56ibhJflY_lDgkgpLfLDsxqIJz0_lyworeQuiwa3zbMhEbouYSbgT1IJ3kyOejLA5uNwUdKLZ4UHCX8daDp1GbxRY4 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Project-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Project-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7a4e84122c3c4cb68c55043fd3c4db35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Tenant: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Tenant-Id: 7a4e84122c3c4cb68c55043fd3c4db35 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-TestMinimumBasicScenario-17585386 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-User: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:15:31 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:15:31 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:15:31 user devstack@n-api.service[61646]: X-User-Id: b59b8f9b395149c7a2eef067766f0935 Apr 14 06:15:31 user devstack@n-api.service[61646]: X-User-Name: tempest-TestMinimumBasicScenario-17585386-project-member Apr 14 06:15:31 user devstack@n-api.service[61646]: method: > Apr 14 06:15:31 user devstack@n-api.service[61646]: exception: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. Apr 14 06:15:31 user devstack@n-api.service[61646]: action_args: {'id': '10c629c7-bbc9-4ddc-8284-64017419fada'} Apr 14 06:15:31 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. Apr 14 06:15:31 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:15:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Returning 404 to user: Instance 10c629c7-bbc9-4ddc-8284-64017419fada could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:15:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-dc329a59-7373-4c2d-b8b2-af8f3e46168e tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada" status: 404 len: 111 microversion: 2.1 time: 0.032513 Apr 14 06:15:31 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 317/960] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:15:31 2023] GET /compute/v2.1/servers/10c629c7-bbc9-4ddc-8284-64017419fada => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:15:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-8afd0a43-ec93-4756-95f8-5445b4d4c757 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] Calling method '.version_select at 0x7f55e29879a0>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-8afd0a43-ec93-4756-95f8-5445b4d4c757 tempest-TestMinimumBasicScenario-17585386 tempest-TestMinimumBasicScenario-17585386-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-837934314" status: 202 len: 0 microversion: 2.1 time: 0.025053 Apr 14 06:15:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 323/961] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 06:15:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-837934314 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:15:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:15:57 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 HTTP/1.1 Apr 14 06:15:57 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:15:57 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:15:57 user devstack@n-api.service[61645]: Connection: close Apr 14 06:15:57 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:15:57 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:15:57 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:15:57 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:15:57 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:15:57 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:15:57 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:15:57 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:15:57 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:15:57 user devstack@n-api.service[61645]: method: > Apr 14 06:15:57 user devstack@n-api.service[61645]: exception: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:15:57 user devstack@n-api.service[61645]: action_args: {'id': '0e5cb774-a032-4c16-86a4-e43d6b5d1d68'} Apr 14 06:15:57 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:15:57 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:15:58 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:15:58 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:15:58 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:15:58 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:15:58 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:15:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e94cfe14-3550-4ba2-b626-fa538612f936 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 404 len: 111 microversion: 2.1 time: 0.034606 Apr 14 06:15:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 322/962] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:15:57 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:15:58 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7cdb7eff-814a-43d2-a790-8227ed100590 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '.version_select at 0x7f55e28e7e20>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:58 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:58 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7cdb7eff-814a-43d2-a790-8227ed100590 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89290876" status: 202 len: 0 microversion: 2.1 time: 0.029680 Apr 14 06:15:58 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 318/963] 10.0.0.210 () {62 vars in 1292 bytes} [Fri Apr 14 06:15:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89290876 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:58 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'services' on Instance uuid 659408d9-ad86-4482-82dd-710e064e02a1 {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:15:58 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-70783a50-00f5-4256-8a00-66d987217642 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments/e16793cd-59f8-4d57-a866-11ff27a42949" status: 202 len: 0 microversion: 2.1 time: 0.174720 Apr 14 06:15:58 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 324/964] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:15:58 2023] DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments/e16793cd-59f8-4d57-a866-11ff27a42949 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:15:58 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:15:58 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4f492aa0-b5ef-495d-ada6-b3b7e417fad7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 Apr 14 06:15:58 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 323/965] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:15:58 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:31 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:16:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-ac757a95-b524-4982-896a-c545bd1ea26b tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 204 len: 0 microversion: 2.1 time: 0.113272 Apr 14 06:16:31 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 319/966] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:16:31 2023] DELETE /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:31 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:16:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-75c1a56f-9e75-4883-a08d-0d65b8b7a130 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 200 len: 1554 microversion: 2.1 time: 0.166788 Apr 14 06:16:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 325/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:16:31 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-unplugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:31 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] Creating event network-vif-unplugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-bcb5abfe-447e-4bbe-a544-b9de2a10141a req-10f8afdd-a93b-40cb-9db7-8e916d806f37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035994 Apr 14 06:16:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 324/968] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:16:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}, {"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}, {"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}, {"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-unplugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}, {"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-plugged", "status": "completed", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:16:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:33 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Creating event network-vif-unplugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] Creating event network-vif-plugged:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:33 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-417b9351-46d3-4663-a5d1-0361b4944440 req-887d6f50-46a0-4166-9e9b-7906f4c5bfe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.058169 Apr 14 06:16:33 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 320/969] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:16:33 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:16:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "216d6140-f106-4928-aa06-bc2d9e860f32", "name": "network-vif-deleted", "tag": "7257f770-94f7-4c6a-aefd-c1aaeb04af04"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:16:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] Creating event network-vif-deleted:7257f770-94f7-4c6a-aefd-c1aaeb04af04 for instance 216d6140-f106-4928-aa06-bc2d9e860f32 on user Apr 14 06:16:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-dee14749-fd86-4fed-beef-8203b07acfa4 req-56d79194-fa89-4c46-9c94-370561943511 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039400 Apr 14 06:16:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 326/970] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:16:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:16:48 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:48 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9c54ad0b-a1d9-4c17-bc23-1b064d58232d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.317690 Apr 14 06:16:49 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 325/971] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:16:48 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1/os-volume_attachments => generated 25 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Going to try to terminate instance {{(pid=61646) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:16:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b63f64e8-4fc0-455a-be37-4a224945c8e6 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 204 len: 0 microversion: 2.1 time: 0.117674 Apr 14 06:16:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 321/972] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:16:49 2023] DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:16:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-77d2d6bf-827b-44f1-af1e-564c9947b210 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 200 len: 1669 microversion: 2.1 time: 0.282442 Apr 14 06:16:49 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 327/973] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:16:49 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "name": "network-vif-unplugged", "status": "completed", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:49 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:49 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] Creating event network-vif-unplugged:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:16:49 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-85c790ba-3109-4617-af5f-15e1934fc0fe req-13bd9563-9817-4c77-a83b-b26a03612a14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028089 Apr 14 06:16:49 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 326/974] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:16:51 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "name": "network-vif-plugged", "status": "completed", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}, {"server_uuid": "659408d9-ad86-4482-82dd-710e064e02a1", "name": "network-vif-deleted", "tag": "51eac7c6-f096-473a-90ae-534ed4210867"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:16:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:16:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:16:51 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:16:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Creating event network-vif-plugged:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:16:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] Creating event network-vif-deleted:51eac7c6-f096-473a-90ae-534ed4210867 for instance 659408d9-ad86-4482-82dd-710e064e02a1 on user Apr 14 06:16:51 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-3939f94f-2b2b-4017-8c03-84139f9db02f req-70a490f0-0efe-446e-be5c-7680231fd44e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038247 Apr 14 06:16:51 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 322/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:17:21 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 HTTP/1.1 Apr 14 06:17:21 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:17:21 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:17:21 user devstack@n-api.service[61644]: Connection: close Apr 14 06:17:21 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:17:21 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:17:21 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:17:21 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:17:21 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61644]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61644]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:17:21 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61644]: method: > Apr 14 06:17:21 user devstack@n-api.service[61644]: exception: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61644]: action_args: {'id': '216d6140-f106-4928-aa06-bc2d9e860f32'} Apr 14 06:17:21 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:17:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-3afe5e29-e47e-4f2c-a844-13812ace4ebf tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 404 len: 111 microversion: 2.1 time: 0.052471 Apr 14 06:17:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 328/976] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:17:21 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:17:21 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 HTTP/1.1 Apr 14 06:17:21 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:17:21 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:17:21 user devstack@n-api.service[61645]: Connection: close Apr 14 06:17:21 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:17:21 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:17:21 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:17:21 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:17:21 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61645]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61645]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:17:21 user devstack@n-api.service[61645]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61645]: method: > Apr 14 06:17:21 user devstack@n-api.service[61645]: exception: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61645]: action_args: {'id': '216d6140-f106-4928-aa06-bc2d9e860f32'} Apr 14 06:17:21 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:17:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-82e7a600-efb2-485b-a14b-4aeed8853b1c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 404 len: 111 microversion: 2.1 time: 0.038679 Apr 14 06:17:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 327/977] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:17:21 2023] DELETE /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 216d6140-f106-4928-aa06-bc2d9e860f32] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:17:21 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 HTTP/1.1 Apr 14 06:17:21 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:17:21 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:17:21 user devstack@n-api.service[61646]: Connection: close Apr 14 06:17:21 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:17:21 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:17:21 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:17:21 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:17:21 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:17:21 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:17:21 user devstack@n-api.service[61646]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:17:21 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:17:21 user devstack@n-api.service[61646]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:17:21 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:17:21 user devstack@n-api.service[61646]: method: > Apr 14 06:17:21 user devstack@n-api.service[61646]: exception: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61646]: action_args: {'id': '216d6140-f106-4928-aa06-bc2d9e860f32'} Apr 14 06:17:21 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. Apr 14 06:17:21 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:17:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 216d6140-f106-4928-aa06-bc2d9e860f32 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:17:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-79f663ce-ccee-4c2c-b62a-d77c9dcdf55c tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32" status: 404 len: 111 microversion: 2.1 time: 0.039172 Apr 14 06:17:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 323/978] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:17:21 2023] GET /compute/v2.1/servers/216d6140-f106-4928-aa06-bc2d9e860f32 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:22 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Going to try to terminate instance {{(pid=61644) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:17:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c14c5957-4b79-431b-8c18-ad7e29dadd6a tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 204 len: 0 microversion: 2.1 time: 0.367841 Apr 14 06:17:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 329/979] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:17:21 2023] DELETE /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:22 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-unplugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:22 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] Creating event network-vif-unplugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:22 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-6420b5fe-31b9-4686-aa4f-f3a7a8c6c1f7 req-49a51da9-e32b-44fc-ae69-a09d1334a2ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135575 Apr 14 06:17:22 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 324/980] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:22 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '290b67b22a91443fbfc829fa4e3db036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc4321a7868464faa59341018ed747f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:17:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-759922e8-e7b7-4b71-8b2a-3ccf5beeb47e tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 200 len: 1546 microversion: 2.1 time: 0.423421 Apr 14 06:17:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 328/981] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:17:22 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 1546 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:17:23 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-deleted", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] Creating event network-vif-deleted:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f4bb0b0c-4a4d-4ac6-94b8-8f0308effd7b req-e4181b97-7d3d-4beb-8575-ebfd0966ea3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032342 Apr 14 06:17:23 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 330/982] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}, {"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}, {"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}, {"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-unplugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}, {"server_uuid": "594c89a2-66e3-4d1d-8331-60a6aa03c66c", "name": "network-vif-plugged", "status": "completed", "tag": "1368a896-f16c-4222-9542-c591daa2e361"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Creating event network-vif-unplugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] Creating event network-vif-plugged:1368a896-f16c-4222-9542-c591daa2e361 for instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c on user Apr 14 06:17:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a75a9dfc-d9a0-4200-a421-659c2903e47c req-6542ec23-4b5e-4be0-a1d4-2fe2feff512d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030953 Apr 14 06:17:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 325/983] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:17:39 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 HTTP/1.1 Apr 14 06:17:39 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:17:39 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:17:39 user devstack@n-api.service[61645]: Connection: close Apr 14 06:17:39 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:17:39 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:17:39 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:17:39 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:17:39 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:17:39 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:17:39 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:17:39 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:17:39 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:17:39 user devstack@n-api.service[61645]: method: > Apr 14 06:17:39 user devstack@n-api.service[61645]: exception: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:17:39 user devstack@n-api.service[61645]: action_args: {'id': '659408d9-ad86-4482-82dd-710e064e02a1'} Apr 14 06:17:39 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:17:39 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:17:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:17:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-93365581-c0a3-40ca-9004-3ce175795fa8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 404 len: 111 microversion: 2.1 time: 0.035228 Apr 14 06:17:39 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 329/984] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:17:39 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:17:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a7b61bb4-94f5-447c-bb28-befa87f4e3a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '.version_select at 0x7f55c86ba170>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a7b61bb4-94f5-447c-bb28-befa87f4e3a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140459230" status: 202 len: 0 microversion: 2.1 time: 0.032607 Apr 14 06:17:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 331/985] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 06:17:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140459230 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:17:40 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:40 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:17:40 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-fda04afd-82be-487e-9697-58fcfb0e7d87 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: .version_select at 0x7f55e28e5480>, body: {"keypair": {"name": "tempest-keypair-1767081454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHl9rjESEyj/xQy1K6phJqwsUzo/nEYL//jJfu5dMId2YL4VarlPegLgYPQgivwb2Wqs9qt4pL/mOlAlpvvQXPcmK6ZzLy9k8NgQpR8zO8LRfwfDcZ7lzSso7PTHYh8G8g=="}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:40 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-fda04afd-82be-487e-9697-58fcfb0e7d87 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:17:40 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-fda04afd-82be-487e-9697-58fcfb0e7d87 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:17:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-fda04afd-82be-487e-9697-58fcfb0e7d87 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051984 Apr 14 06:17:40 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 326/986] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:17:40 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:17:42 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-859725183", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848"}], "security_groups": [{"name": "tempest-securitygroup--418403782"}], "key_name": "tempest-keypair-1767081454", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:42 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] validate_networks() for [('45c8f442-1ff6-4f22-99ec-a3d77b4ba848', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:17:43 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:17:43 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ccf0bc16-d6ed-4951-afe5-2a91a1199347 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.249861 Apr 14 06:17:43 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 330/987] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:17:42 2023] POST /compute/v2.1/servers => generated 399 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:17:43 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f8cabe02-e31b-4b13-9fe7-ac90e2231295 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:17:43 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f8cabe02-e31b-4b13-9fe7-ac90e2231295 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:17:43 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-f8cabe02-e31b-4b13-9fe7-ac90e2231295 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:17:43 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f8cabe02-e31b-4b13-9fe7-ac90e2231295 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 200 len: 1235 microversion: 2.1 time: 0.120787 Apr 14 06:17:43 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 332/988] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:17:43 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 1235 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:17:45 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:45 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] Creating event network-changed:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:17:45 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-9d3cdd49-37fc-443d-a556-d0642f76ac61 req-d0386477-f838-40d5-9a8e-8c2a7e86c9b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028613 Apr 14 06:17:45 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 327/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "name": "network-vif-plugged", "status": "completed", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] Creating event network-vif-plugged:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:17:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-8ce6d340-4cd6-4620-b40d-c583069c8dc5 req-77d0ef78-feee-4ca1-9b54-58050a597396 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041661 Apr 14 06:17:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 331/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:17:49 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "name": "network-vif-plugged", "status": "completed", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:17:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:17:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:17:49 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:17:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] Creating event network-vif-plugged:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:17:49 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-275af5bc-7bb5-4176-ab55-98d096d7014e req-bf0cb19c-fd01-4ab1-9524-6b561e950369 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034323 Apr 14 06:17:49 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 333/991] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 594c89a2-66e3-4d1d-8331-60a6aa03c66c] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:18:12 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c HTTP/1.1 Apr 14 06:18:12 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:18:12 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:18:12 user devstack@n-api.service[61646]: Connection: close Apr 14 06:18:12 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:18:12 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:18:12 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:18:12 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:18:12 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:12 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:12 user devstack@n-api.service[61646]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:12 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:18:12 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:18:12 user devstack@n-api.service[61646]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:18:12 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:12 user devstack@n-api.service[61646]: method: > Apr 14 06:18:12 user devstack@n-api.service[61646]: exception: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. Apr 14 06:18:12 user devstack@n-api.service[61646]: action_args: {'id': '594c89a2-66e3-4d1d-8331-60a6aa03c66c'} Apr 14 06:18:12 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. Apr 14 06:18:12 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:18:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 594c89a2-66e3-4d1d-8331-60a6aa03c66c could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:18:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d9aceef0-340d-49f8-a386-b60f1739ab0d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c" status: 404 len: 111 microversion: 2.1 time: 0.048285 Apr 14 06:18:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 328/992] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:18:12 2023] GET /compute/v2.1/servers/594c89a2-66e3-4d1d-8331-60a6aa03c66c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:18:21 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 HTTP/1.1 Apr 14 06:18:21 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:18:21 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:18:21 user devstack@n-api.service[61645]: Connection: close Apr 14 06:18:21 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:18:21 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:18:21 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:18:21 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:18:21 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:21 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61645]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:21 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:18:21 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:18:21 user devstack@n-api.service[61645]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:18:21 user devstack@n-api.service[61645]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:21 user devstack@n-api.service[61645]: method: > Apr 14 06:18:21 user devstack@n-api.service[61645]: exception: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61645]: action_args: {'id': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'} Apr 14 06:18:21 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:18:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-36821cc6-1cc8-45f8-9980-874b549b4dc5 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 404 len: 111 microversion: 2.1 time: 0.043543 Apr 14 06:18:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 332/993] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:18:21 2023] DELETE /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] [instance: 4e8ac55a-5fe7-470b-b04e-97a9f00f3187] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] HTTP exception thrown: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Request method failure captured: Apr 14 06:18:21 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 HTTP/1.1 Apr 14 06:18:21 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:18:21 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:18:21 user devstack@n-api.service[61644]: Connection: close Apr 14 06:18:21 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:18:21 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:18:21 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:18:21 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:18:21 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOOphD8JtZZpJiJna77BIhhUPhjTJI7-k5R9EH2PDQ-AYzuqQ9kd4XTowAGxtj-E3_PoV-YW_lHPclb_Z0gEKlCJ_a1CdPeiShfjBSxc4UwLBowmT-m_UWM2pgMMVd-0vwIJdZa_Sqe5RW-DTYjXEGUz5hO0T0D9_7XjeMLs1Cmt72ws Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Project-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dbc4321a7868464faa59341018ed747f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dbc4321a7868464faa59341018ed747f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Tenant-Id: dbc4321a7868464faa59341018ed747f Apr 14 06:18:21 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerActionsTestJSON-31064769 Apr 14 06:18:21 user devstack@n-api.service[61644]: X-User: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:21 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:18:21 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:18:21 user devstack@n-api.service[61644]: X-User-Id: 290b67b22a91443fbfc829fa4e3db036 Apr 14 06:18:21 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerActionsTestJSON-31064769-project-member Apr 14 06:18:21 user devstack@n-api.service[61644]: method: > Apr 14 06:18:21 user devstack@n-api.service[61644]: exception: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61644]: action_args: {'id': '4e8ac55a-5fe7-470b-b04e-97a9f00f3187'} Apr 14 06:18:21 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. Apr 14 06:18:21 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:18:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Returning 404 to user: Instance 4e8ac55a-5fe7-470b-b04e-97a9f00f3187 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:18:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1cd0724c-1f71-4826-9461-7f2e6f1c4948 tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187" status: 404 len: 111 microversion: 2.1 time: 0.040106 Apr 14 06:18:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 334/994] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:18:21 2023] GET /compute/v2.1/servers/4e8ac55a-5fe7-470b-b04e-97a9f00f3187 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:18:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d7b1f7d1-91dc-40eb-9bcc-af63265fb20d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] Calling method '.version_select at 0x7f55e2892560>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d7b1f7d1-91dc-40eb-9bcc-af63265fb20d tempest-ServerActionsTestJSON-31064769 tempest-ServerActionsTestJSON-31064769-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592565508" status: 202 len: 0 microversion: 2.1 time: 0.023789 Apr 14 06:18:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 329/995] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 06:18:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1592565508 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1264137081", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] validate_networks() for [('fa1bd7e5-13e4-45fc-bb2a-6455917df1a5', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:32 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for user 67c2d41a3a2e40a3bc67feafbfe4f5ca and project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:18:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d7e3eece-1472-45b7-b669-6ea1f1300b77 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.634855 Apr 14 06:18:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 333/996] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:18:32 2023] POST /compute/v2.1/servers => generated 381 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 06:18:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5661833d-0653-40c4-b109-053e42ea44da tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:33 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5661833d-0653-40c4-b109-053e42ea44da tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:33 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-5661833d-0653-40c4-b109-053e42ea44da tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:18:33 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5661833d-0653-40c4-b109-053e42ea44da tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1216 microversion: 2.1 time: 0.076580 Apr 14 06:18:33 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 335/997] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:18:33 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:18:33 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:33 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:18:33 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-897572158", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:33 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] validate_networks() for [('fa1bd7e5-13e4-45fc-bb2a-6455917df1a5', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:33 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:18:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-73ab0bef-8ce3-4643-9879-e7f80d918451 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 200 len: 1544 microversion: 2.1 time: 0.232187 Apr 14 06:18:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 334/998] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:18:33 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for user 67c2d41a3a2e40a3bc67feafbfe4f5ca and project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:18:34 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:18:34 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-6dad994e-bd5e-4db7-8382-fa0f7ae356db tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.924081 Apr 14 06:18:34 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 330/999] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:18:33 2023] POST /compute/v2.1/servers => generated 381 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:18:34 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a4eb3840-0137-4022-85f7-a5b07b25e98c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:18:34 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a4eb3840-0137-4022-85f7-a5b07b25e98c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:18:34 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-a4eb3840-0137-4022-85f7-a5b07b25e98c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:18:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a4eb3840-0137-4022-85f7-a5b07b25e98c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 200 len: 1215 microversion: 2.1 time: 0.084189 Apr 14 06:18:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 336/1000] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:18:34 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:18:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] Creating event network-changed:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:18:36 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-1c682546-9685-4447-9e32-104f3defc884 req-04b52712-8227-4473-ab87-3fabac74f061 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104889 Apr 14 06:18:36 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 335/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:18:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:18:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] Creating event network-changed:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:18:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-87a5b4f6-3e92-4cf9-b0d8-1e1cc1056f0f req-7c2764f3-ac29-4866-b676-c1deabac7909 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084059 Apr 14 06:18:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 331/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:18:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:18:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:18:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b01bad3e-9f84-4ec4-a1f6-73a73abe873a req-3f8916dd-0016-4172-859f-7d64b518f4fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 Apr 14 06:18:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 337/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:18:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}, {"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:18:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:18:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:18:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:18:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:18:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:18:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:18:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-002ba057-0140-4531-b356-e29e0606de4b req-7aacccbe-a1a0-4eef-81f8-43a095e2e0bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035871 Apr 14 06:18:40 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 336/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:18:40 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:24 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:19:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d26cf364-b8ad-470b-ad9b-ae7d9a78da5c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 200 len: 1503 microversion: 2.1 time: 0.175804 Apr 14 06:19:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 332/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:19:24 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:33 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:34 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1a461b9a-4410-485e-ab80-0debd67e1cab tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.130424 Apr 14 06:19:34 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 338/1006] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:19:33 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-interface => generated 283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=12 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] Creating event network-changed:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:19:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-2904b05d-fabb-4024-99fe-74bfb6876548 req-ad97f498-6eda-42a7-b443-b2f96013cb18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048788 Apr 14 06:19:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 337/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d25b4829-9274-4405-a1e1-77a97c0eba8a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/ips" status: 200 len: 108 microversion: 2.1 time: 0.055184 Apr 14 06:19:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 333/1008] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:19:35 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/ips => generated 108 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24895241-f12a-4e80-80f0-7a0fa5cab5df"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5008437d-ca45-4a88-8ea4-cac540ace07f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291136 Apr 14 06:19:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 339/1009] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:19:37 2023] POST /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24895241-f12a-4e80-80f0-7a0fa5cab5df"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:19:44 user devstack@n-api.service[61645]: request: POST /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments HTTP/1.1 Apr 14 06:19:44 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:19:44 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:19:44 user devstack@n-api.service[61645]: Connection: close Apr 14 06:19:44 user devstack@n-api.service[61645]: Content-Length: 74 Apr 14 06:19:44 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:19:44 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:19:44 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:19:44 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:19:44 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:19:44 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:19:44 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:19:44 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:19:44 user devstack@n-api.service[61645]: Apr 14 06:19:44 user devstack@n-api.service[61645]: {"volumeAttachment": {"volumeId": "24895241-f12a-4e80-80f0-7a0fa5cab5df"}} Apr 14 06:19:44 user devstack@n-api.service[61645]: method: > Apr 14 06:19:44 user devstack@n-api.service[61645]: exception: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 Apr 14 06:19:44 user devstack@n-api.service[61645]: action_args: {'server_id': 'aed587e2-a592-4241-9088-d15c4856f6f8', 'body': {'volumeAttachment': {'volumeId': '24895241-f12a-4e80-80f0-7a0fa5cab5df'}}} Apr 14 06:19:44 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 Apr 14 06:19:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:19:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 400 to user: Invalid volume: volume 24895241-f12a-4e80-80f0-7a0fa5cab5df is already attached to instances: aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:19:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-cb9ff25d-3d7b-4a89-9093-1ddfa442a599 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135411 Apr 14 06:19:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 338/1010] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:19:44 2023] POST /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:44 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'services' on Instance uuid aed587e2-a592-4241-9088-d15c4856f6f8 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:19:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b4c7904b-c5a6-470e-b4f3-6bb0613da0f0 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments/24895241-f12a-4e80-80f0-7a0fa5cab5df" status: 202 len: 0 microversion: 2.1 time: 0.175395 Apr 14 06:19:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 334/1011] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:19:44 2023] DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments/24895241-f12a-4e80-80f0-7a0fa5cab5df => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:19:45 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:19:45 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5bc3ceaf-e60a-4077-aaa8-635bf1e9124c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093707 Apr 14 06:19:45 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 340/1012] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:19:44 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:24 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid 6cf8ae21-6690-4390-9990-690333025c17 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:20:24 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-dc2ab919-69d3-4db7-9f75-4d58ad5f0f96 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17/action" status: 200 len: 32 microversion: 2.1 time: 0.114187 Apr 14 06:20:24 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 339/1013] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:20:24 2023] POST /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:24 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:20:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-68c63385-8088-45f5-8315-7f6b21f99b53 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 200 len: 1509 microversion: 2.1 time: 0.167922 Apr 14 06:20:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 335/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:20:24 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-unplugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:25 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] Creating event network-vif-unplugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:20:25 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-b6a78637-3bcf-4ea0-862b-e5031fd30e95 req-2cb400c7-4571-441e-a4e1-fa41a3a28336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064575 Apr 14 06:20:25 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 341/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:20:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e783b014-8f69-4e3a-b4a2-36343438ec01 req-a96cabb5-8619-4e94-b97b-3aff06a1864c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036953 Apr 14 06:20:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 340/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}, {"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:20:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:20:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-d63933eb-e9a4-45fd-a711-b184e5342e01 req-bb2146c4-e546-45e4-bbd8-dfa30d1febc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029538 Apr 14 06:20:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 336/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-267223b5-08be-40a7-aef7-d5f73c8141f3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059219 Apr 14 06:20:35 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 342/1018] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:20:35 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:20:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7f67e946-b0e0-4c6a-8abe-acc759b14b27 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 204 len: 0 microversion: 2.1 time: 0.163932 Apr 14 06:20:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 341/1019] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:20:35 2023] DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "name": "network-vif-unplugged", "status": "completed", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-1b5e5a61-7b81-413d-9baf-279c9ac6f5dc tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 200 len: 1669 microversion: 2.1 time: 0.211291 Apr 14 06:20:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 337/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:20:35 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:35 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] Creating event network-vif-unplugged:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:20:35 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-187a26af-e500-4156-9b64-45dc9bb52367 req-b3a2b007-84c9-4806-96eb-20ce5be621c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032459 Apr 14 06:20:35 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 343/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:36 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "name": "network-vif-deleted", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:36 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] Creating event network-vif-deleted:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:20:37 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e050e7bb-e915-4224-8e8e-7e4dfdfebec9 req-6a26a450-80f3-4815-aecc-6e1f7961d8a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074724 Apr 14 06:20:37 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 342/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:20:37 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aed587e2-a592-4241-9088-d15c4856f6f8", "name": "network-vif-plugged", "status": "completed", "tag": "7bca777d-f535-4686-8b83-bb2d216cb909"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:20:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:20:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:20:37 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:20:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] Creating event network-vif-plugged:7bca777d-f535-4686-8b83-bb2d216cb909 for instance aed587e2-a592-4241-9088-d15c4856f6f8 on user Apr 14 06:20:37 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-8ec4fd2f-7826-4f45-86ab-dc12bff944de req-a4ff4152-cfdb-4af7-9510-6161fe2bf09f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027449 Apr 14 06:20:37 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 338/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:14 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:15 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:21:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b7aff0a2-520e-4989-bb19-be1d483a7258 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 200 len: 1489 microversion: 2.1 time: 0.205621 Apr 14 06:21:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 344/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:21:14 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 1489 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:21:25 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 HTTP/1.1 Apr 14 06:21:25 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:21:25 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:21:25 user devstack@n-api.service[61645]: Connection: close Apr 14 06:21:25 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:21:25 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:21:25 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:21:25 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:21:25 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:21:25 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:21:25 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:21:25 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:21:25 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:21:25 user devstack@n-api.service[61645]: method: > Apr 14 06:21:25 user devstack@n-api.service[61645]: exception: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:21:25 user devstack@n-api.service[61645]: action_args: {'id': 'aed587e2-a592-4241-9088-d15c4856f6f8'} Apr 14 06:21:25 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:21:25 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:21:25 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:21:25 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-79943213-d27d-4aab-8d85-d78e1d78331d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 404 len: 111 microversion: 2.1 time: 0.046379 Apr 14 06:21:25 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 343/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:21:25 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:21:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:25 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=16 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:25 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-2105552e-e83b-4feb-94c7-3a7e6af98921 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '.version_select at 0x7f55e28e4790>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:21:25 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-2105552e-e83b-4feb-94c7-3a7e6af98921 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767081454" status: 202 len: 0 microversion: 2.1 time: 0.030594 Apr 14 06:21:25 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 339/1026] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 06:21:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767081454 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:21:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-5c442555-89da-4455-84b2-5dacafde7003 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: .version_select at 0x7f55c86ba4d0>, body: {"keypair": {"name": "tempest-keypair-571487004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbZiTImq4OyW9Y7TV31bmJcjlgIUIWW7knzm0I2QP/Bk9oXJfEytnwR+0Sdt4v7pfe2uAJH5vGwi3eBLHWfEPLj+8plldB5t43Pea0+duLejtopometmPzUNIp0VYb0QQ=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:21:26 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:26 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:21:26 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-5c442555-89da-4455-84b2-5dacafde7003 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:21:26 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-5c442555-89da-4455-84b2-5dacafde7003 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:21:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-5c442555-89da-4455-84b2-5dacafde7003 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058072 Apr 14 06:21:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 345/1027] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:21:26 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391821891", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "45c8f442-1ff6-4f22-99ec-a3d77b4ba848"}], "security_groups": [{"name": "tempest-securitygroup--200955511"}], "key_name": "tempest-keypair-571487004", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] validate_networks() for [('45c8f442-1ff6-4f22-99ec-a3d77b4ba848', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Getting quotas for user 6ce33b21c6d541a0a4885680baf52f64 and project 86f67a892b9045089159f210e7db3a80. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:21:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:21:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ce033ae0-b243-47a5-aade-9010d6b7f999 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.554454 Apr 14 06:21:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 344/1028] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:21:28 2023] POST /compute/v2.1/servers => generated 399 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:21:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f742572b-94a0-45fa-8cc0-4f6d2fd163d3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:21:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f742572b-94a0-45fa-8cc0-4f6d2fd163d3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:21:28 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f742572b-94a0-45fa-8cc0-4f6d2fd163d3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:21:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f742572b-94a0-45fa-8cc0-4f6d2fd163d3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 200 len: 1234 microversion: 2.1 time: 0.065998 Apr 14 06:21:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 340/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:21:28 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:21:31 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:21:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:31 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] Creating event network-changed:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:21:31 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-311a236e-d4c7-43c9-b062-1c5c2344011b req-e806fbed-3cb6-4bf8-850c-0a3d2b6772e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037207 Apr 14 06:21:31 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 346/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:21:33 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "name": "network-vif-plugged", "status": "completed", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:21:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:33 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] Creating event network-vif-plugged:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:21:33 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-5a403e34-10e9-42cf-941a-d409663b29a4 req-00f99251-ff15-42d8-a6b9-0509d39c3bbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041264 Apr 14 06:21:33 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 345/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:21:35 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "name": "network-vif-plugged", "status": "completed", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:21:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:21:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:21:35 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:21:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] Creating event network-vif-plugged:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:21:35 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-10667f8b-9087-4b26-8a45-5f8ecfc8374c req-6f7b30c5-a042-4667-893c-1c1daf348840 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030794 Apr 14 06:21:35 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 341/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:22:15 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:22:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-7d638938-99b6-40af-9bdf-e24059ecea45 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1505 microversion: 2.1 time: 0.192036 Apr 14 06:22:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 347/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:22:15 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:22:19 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:22:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7edcfe43-988a-4fb3-b380-489c14bbdbc8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 200 len: 1542 microversion: 2.1 time: 0.213341 Apr 14 06:22:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 346/1034] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:22:19 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 1542 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:23:17 user devstack@n-api.service[61646]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:17 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:23:17 user devstack@n-api.service[61646]: Fri Apr 14 06:23:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/action (ip 10.0.0.210) !!! Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:18 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid edc258d3-78b8-4f61-a648-6452dcc62355 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:23:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-b9a2e452-6339-403e-80b9-2df0c7cd1564 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/action" status: 200 len: 32 microversion: 2.1 time: 0.124002 Apr 14 06:23:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 342/1035] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:23:17 2023] POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/action => generated 32 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:18 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:23:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a87a913b-3b90-4413-b1a5-f96f70ad7f5d tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1511 microversion: 2.1 time: 0.252659 Apr 14 06:23:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 348/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:23:18 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1511 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:23:18 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:23:18 user devstack@n-api.service[61645]: Fri Apr 14 06:23:18 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] Creating event network-vif-unplugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-b85f242c-d8d4-44e4-859b-9d270b7cbe0b req-bd5a001d-2158-4350-b723-25944f203e7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049195 Apr 14 06:23:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 347/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:23:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:19 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35806. Apr 14 06:23:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-61e4445d-2953-49ce-a172-a88d0e25c43f tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101478 Apr 14 06:23:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 343/1038] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:23:19 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:23:20 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] Creating event network-changed:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:23:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-f41342ff-b6ed-459e-95cd-4f04d25b6cf5 req-9301ab9e-63cd-4c23-8f5a-d9a5d5b5fc4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037577 Apr 14 06:23:20 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 349/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:20 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:20 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-a56f7402-a0ff-47c9-aa19-5931e35eaea2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/ips" status: 200 len: 107 microversion: 2.1 time: 0.042331 Apr 14 06:23:20 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 348/1040] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 06:23:20 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/ips => generated 107 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:20 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Creating event network-vif-unplugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-9a670af1-0a1c-40e0-8aa5-03ae0dc240ae req-476b5700-f746-4dda-8361-55c0296c7a66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038085 Apr 14 06:23:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 344/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3a423ae-aa92-477f-b35e-22eff1fe2d12"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:23 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:23:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:23:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-adf7e1e3-02ac-4056-b970-e4f939ea9382 req-3b1daf28-4956-42b0-ad72-8ca8be79aecc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033120 Apr 14 06:23:23 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 349/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-49fe302d-0389-4de4-93cb-82deb336034a tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301065 Apr 14 06:23:23 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 350/1043] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:23:22 2023] POST /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:30 user devstack@n-api.service[61646]: DEBUG nova.objects.instance [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lazy-loading 'services' on Instance uuid 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 {{(pid=61646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:23:30 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-10e234bb-24d4-484e-b5f2-28404e053e4e tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments/e3a423ae-aa92-477f-b35e-22eff1fe2d12" status: 202 len: 0 microversion: 2.1 time: 0.159132 Apr 14 06:23:30 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 345/1044] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:23:30 2023] DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments/e3a423ae-aa92-477f-b35e-22eff1fe2d12 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:23:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:23:31 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-5632f97d-c554-4b57-91b9-c48a643363f2 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045331 Apr 14 06:23:31 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 350/1045] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:23:30 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:24:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c651a52d-e000-4112-86e4-066ea77e5346 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1491 microversion: 2.1 time: 0.215895 Apr 14 06:24:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 351/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:24:08 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1491 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:24:21 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:24:21 user devstack@n-api.service[61646]: Fri Apr 14 06:24:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4b3ccbd3-1ad3-4472-b979-5d5374781b8d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055789 Apr 14 06:24:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 346/1047] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:24:21 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:24:21 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:24:21 user devstack@n-api.service[61645]: Fri Apr 14 06:24:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 (ip 10.0.0.210) !!! Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=14 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:24:21 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-e5fae6d5-c489-4191-ab8e-b6403326af1b tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 204 len: 0 microversion: 2.1 time: 0.137663 Apr 14 06:24:21 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 351/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:24:21 2023] DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ce33b21c6d541a0a4885680baf52f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86f67a892b9045089159f210e7db3a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:24:21 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-4e0e0f9b-5d8a-4dfe-a57f-112bd35b9fb7 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 200 len: 1665 microversion: 2.1 time: 0.196095 Apr 14 06:24:21 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 352/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:24:21 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 1665 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "name": "network-vif-unplugged", "status": "completed", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:21 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] Creating event network-vif-unplugged:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:24:21 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-20e06f15-ccbb-4049-be7a-ff4675282541 req-fb9129d6-0569-4bd4-984f-c2511e5ddf00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098072 Apr 14 06:24:21 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 347/1050] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:24:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:24:23 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "name": "network-vif-plugged", "status": "completed", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:24:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:23 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] Creating event network-vif-plugged:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:24:23 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c038bb5-1cd7-412b-9f53-6fd7ea81b623", "name": "network-vif-deleted", "tag": "686f7f32-506f-4cc9-850e-c03b3925c762"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:24:23 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-020590cd-562d-4c30-bbab-d6fa5b863fe9 req-c0408676-f19c-4016-8cca-eec5c5289ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030458 Apr 14 06:24:23 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 353/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:24:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:24:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:24:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:24:23 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:24:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] Creating event network-vif-deleted:686f7f32-506f-4cc9-850e-c03b3925c762 for instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 on user Apr 14 06:24:23 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-93399ab5-4685-4c1e-8da5-4a81314bc580 req-9a8271e4-35cb-420f-a80a-be039cfad826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087759 Apr 14 06:24:23 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 352/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:24:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0393e6a-c61f-4947-ac48-c41d9582a5fd"}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HTTP exception thrown: Cannot 'attach_volume' instance edc258d3-78b8-4f61-a648-6452dcc62355 while it is in vm_state rescued Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Request method failure captured: Apr 14 06:25:08 user devstack@n-api.service[61646]: request: POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/os-volume_attachments HTTP/1.1 Apr 14 06:25:08 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:25:08 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:25:08 user devstack@n-api.service[61646]: Connection: close Apr 14 06:25:08 user devstack@n-api.service[61646]: Content-Length: 74 Apr 14 06:25:08 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:25:08 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:25:08 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:25:08 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOPA40kz1CSkfXkpa41TYTiDmycP5PvUSpqXCy0HaeyGOfap2xFlB788Yn2DI1Hz8sypwqOzUVS9Y6K7a89us9BTRBQfUXoGKi7itENvfA3NTD3xwav7UuDXhasVaAQQT5v1qRqP_-QGMGupuMJGEuN32sds1xkSDtBsmszVPl-kzEyA Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Project-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Tenant-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:25:08 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:25:08 user devstack@n-api.service[61646]: X-User: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:25:08 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:25:08 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:25:08 user devstack@n-api.service[61646]: X-User-Id: 67c2d41a3a2e40a3bc67feafbfe4f5ca Apr 14 06:25:08 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:25:08 user devstack@n-api.service[61646]: Apr 14 06:25:08 user devstack@n-api.service[61646]: {"volumeAttachment": {"volumeId": "e0393e6a-c61f-4947-ac48-c41d9582a5fd"}} Apr 14 06:25:08 user devstack@n-api.service[61646]: method: > Apr 14 06:25:08 user devstack@n-api.service[61646]: exception: Cannot 'attach_volume' instance edc258d3-78b8-4f61-a648-6452dcc62355 while it is in vm_state rescued Apr 14 06:25:08 user devstack@n-api.service[61646]: action_args: {'server_id': 'edc258d3-78b8-4f61-a648-6452dcc62355', 'body': {'volumeAttachment': {'volumeId': 'e0393e6a-c61f-4947-ac48-c41d9582a5fd'}}} Apr 14 06:25:08 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance edc258d3-78b8-4f61-a648-6452dcc62355 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance edc258d3-78b8-4f61-a648-6452dcc62355 while it is in vm_state rescued Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance edc258d3-78b8-4f61-a648-6452dcc62355 while it is in vm_state rescued Apr 14 06:25:08 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Returning 409 to user: Cannot 'attach_volume' instance edc258d3-78b8-4f61-a648-6452dcc62355 while it is in vm_state rescued {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-359ca41d-0660-4bcd-bccc-241f378fcc0c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051164 Apr 14 06:25:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 348/1053] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:25:08 2023] POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-1780c27e-e2df-4466-a856-68223ca5aad0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/action" status: 202 len: 0 microversion: 2.1 time: 0.081558 Apr 14 06:25:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 354/1054] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:25:08 2023] POST /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:08 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:09 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:25:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-4f19cca4-a2ab-4abd-b87b-cf8291b51ac4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1499 microversion: 2.1 time: 0.229592 Apr 14 06:25:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 353/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:08 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1499 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:25:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:25:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] Creating event network-vif-unplugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:25:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-56cc227d-d957-41a5-a970-ee4ab2ccc9f4 req-db1aa850-914d-4f26-8457-c412a5a7d70b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097869 Apr 14 06:25:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 349/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:25:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:11 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 HTTP/1.1 Apr 14 06:25:11 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:25:11 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:25:11 user devstack@n-api.service[61644]: Connection: close Apr 14 06:25:11 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:25:11 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:25:11 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:25:11 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:25:11 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:11 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:25:11 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:25:11 user devstack@n-api.service[61644]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:11 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:11 user devstack@n-api.service[61644]: method: > Apr 14 06:25:11 user devstack@n-api.service[61644]: exception: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:11 user devstack@n-api.service[61644]: action_args: {'id': '8c038bb5-1cd7-412b-9f53-6fd7ea81b623'} Apr 14 06:25:11 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:11 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-bc9f977c-c9e4-4a41-9743-7c5a5b744f56 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 404 len: 111 microversion: 2.1 time: 0.029400 Apr 14 06:25:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 355/1057] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:11 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-b8cea7f6-e023-4049-85dc-6c7c088a96ad tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '.version_select at 0x7f55e2a15510>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-b8cea7f6-e023-4049-85dc-6c7c088a96ad tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571487004" status: 202 len: 0 microversion: 2.1 time: 0.039297 Apr 14 06:25:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 354/1058] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 06:25:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571487004 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:25:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}, {"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:25:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:25:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:25:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:25:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-72462dce-64d0-44ee-80a8-f4f5dc5284d3 req-88d3869f-aa6d-4a6b-b54d-12cb4e93fb6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.029707 Apr 14 06:25:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 350/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:15 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 HTTP/1.1 Apr 14 06:25:15 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:25:15 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:25:15 user devstack@n-api.service[61644]: Connection: close Apr 14 06:25:15 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:25:15 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:25:15 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:25:15 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:25:15 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:15 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:25:15 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:25:15 user devstack@n-api.service[61644]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:15 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:15 user devstack@n-api.service[61644]: method: > Apr 14 06:25:15 user devstack@n-api.service[61644]: exception: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61644]: action_args: {'id': '8c038bb5-1cd7-412b-9f53-6fd7ea81b623'} Apr 14 06:25:15 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:15 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-f40e0c37-9234-4a99-8e93-1ebc84308964 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 404 len: 111 microversion: 2.1 time: 0.028553 Apr 14 06:25:15 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 356/1060] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:25:15 2023] DELETE /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 8c038bb5-1cd7-412b-9f53-6fd7ea81b623] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:15 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 HTTP/1.1 Apr 14 06:25:15 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:25:15 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:25:15 user devstack@n-api.service[61645]: Connection: close Apr 14 06:25:15 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:25:15 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:25:15 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:25:15 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:25:15 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:15 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:25:15 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:25:15 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:15 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:15 user devstack@n-api.service[61645]: method: > Apr 14 06:25:15 user devstack@n-api.service[61645]: exception: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61645]: action_args: {'id': '8c038bb5-1cd7-412b-9f53-6fd7ea81b623'} Apr 14 06:25:15 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. Apr 14 06:25:15 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:15 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 8c038bb5-1cd7-412b-9f53-6fd7ea81b623 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:15 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-9d4cbc32-718e-4423-9549-eceed9a22c6c tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623" status: 404 len: 111 microversion: 2.1 time: 0.031836 Apr 14 06:25:15 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 355/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:15 2023] GET /compute/v2.1/servers/8c038bb5-1cd7-412b-9f53-6fd7ea81b623 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:18 user devstack@n-api.service[61646]: request: DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 HTTP/1.1 Apr 14 06:25:18 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:25:18 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:25:18 user devstack@n-api.service[61646]: Connection: close Apr 14 06:25:18 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:25:18 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:25:18 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:25:18 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:25:18 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:18 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:25:18 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:25:18 user devstack@n-api.service[61646]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:18 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:18 user devstack@n-api.service[61646]: method: > Apr 14 06:25:18 user devstack@n-api.service[61646]: exception: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61646]: action_args: {'id': 'aed587e2-a592-4241-9088-d15c4856f6f8'} Apr 14 06:25:18 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3714231b-c6cf-42de-88ee-cdd5b5a476a3 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 404 len: 111 microversion: 2.1 time: 0.032354 Apr 14 06:25:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 351/1062] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:25:18 2023] DELETE /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: aed587e2-a592-4241-9088-d15c4856f6f8] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:18 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 HTTP/1.1 Apr 14 06:25:18 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:25:18 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:25:18 user devstack@n-api.service[61644]: Connection: close Apr 14 06:25:18 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:25:18 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:25:18 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:25:18 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:25:18 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:18 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:25:18 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:25:18 user devstack@n-api.service[61644]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:18 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:18 user devstack@n-api.service[61644]: method: > Apr 14 06:25:18 user devstack@n-api.service[61644]: exception: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61644]: action_args: {'id': 'aed587e2-a592-4241-9088-d15c4856f6f8'} Apr 14 06:25:18 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. Apr 14 06:25:18 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:18 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance aed587e2-a592-4241-9088-d15c4856f6f8 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:18 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-035649f7-2819-4ac4-93f2-284e712e91b1 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8" status: 404 len: 111 microversion: 2.1 time: 0.032844 Apr 14 06:25:18 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 357/1063] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:18 2023] GET /compute/v2.1/servers/aed587e2-a592-4241-9088-d15c4856f6f8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:19 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 HTTP/1.1 Apr 14 06:25:19 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:25:19 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:25:19 user devstack@n-api.service[61645]: Connection: close Apr 14 06:25:19 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:25:19 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:25:19 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:25:19 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:25:19 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:19 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:25:19 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:25:19 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:19 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:19 user devstack@n-api.service[61645]: method: > Apr 14 06:25:19 user devstack@n-api.service[61645]: exception: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61645]: action_args: {'id': '0e5cb774-a032-4c16-86a4-e43d6b5d1d68'} Apr 14 06:25:19 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3ab45a54-febd-4343-81e4-185c6179b4d8 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 404 len: 111 microversion: 2.1 time: 0.031004 Apr 14 06:25:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 356/1064] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:25:18 2023] DELETE /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 0e5cb774-a032-4c16-86a4-e43d6b5d1d68] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:19 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 HTTP/1.1 Apr 14 06:25:19 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:25:19 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:25:19 user devstack@n-api.service[61646]: Connection: close Apr 14 06:25:19 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:25:19 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:25:19 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:25:19 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:25:19 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:19 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:25:19 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:25:19 user devstack@n-api.service[61646]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:19 user devstack@n-api.service[61646]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:19 user devstack@n-api.service[61646]: method: > Apr 14 06:25:19 user devstack@n-api.service[61646]: exception: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61646]: action_args: {'id': '0e5cb774-a032-4c16-86a4-e43d6b5d1d68'} Apr 14 06:25:19 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. Apr 14 06:25:19 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:25:19 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 0e5cb774-a032-4c16-86a4-e43d6b5d1d68 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:19 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-d6967096-622c-45a8-8a1f-e6e663294cc9 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68" status: 404 len: 111 microversion: 2.1 time: 0.027325 Apr 14 06:25:19 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 352/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:19 2023] GET /compute/v2.1/servers/0e5cb774-a032-4c16-86a4-e43d6b5d1d68 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:22 user devstack@n-api.service[61644]: request: DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 HTTP/1.1 Apr 14 06:25:22 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:25:22 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:25:22 user devstack@n-api.service[61644]: Connection: close Apr 14 06:25:22 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:25:22 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:25:22 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:25:22 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:25:22 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:22 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:25:22 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:25:22 user devstack@n-api.service[61644]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:22 user devstack@n-api.service[61644]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:22 user devstack@n-api.service[61644]: method: > Apr 14 06:25:22 user devstack@n-api.service[61644]: exception: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61644]: action_args: {'id': '659408d9-ad86-4482-82dd-710e064e02a1'} Apr 14 06:25:22 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:22 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-fa4c924e-d938-4146-a8c1-aa65916b0092 tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 404 len: 111 microversion: 2.1 time: 0.038173 Apr 14 06:25:22 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 358/1066] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:25:22 2023] DELETE /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] [instance: 659408d9-ad86-4482-82dd-710e064e02a1] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] HTTP exception thrown: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Request method failure captured: Apr 14 06:25:22 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 HTTP/1.1 Apr 14 06:25:22 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:25:22 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:25:22 user devstack@n-api.service[61645]: Connection: close Apr 14 06:25:22 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:25:22 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:25:22 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:25:22 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:25:22 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOO5_g4vFPJ_1lWrmij0NMzB0Upp-rfxl2XoKns6nmLa6lgxZ3kD1dzHm47StsgvHQsbWU0c9yCx9kJXbsqJSUliJpF77AD89jXK__hJGqE6Zm5pWiQZMRoC7BNfWK_mMhRU7DXdaJTt5clAmaM6r8043eW0Ke3zWU0gufklqZqzMk5Y Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Project-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Project-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/86f67a892b9045089159f210e7db3a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/86f67a892b9045089159f210e7db3a80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Tenant: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Tenant-Id: 86f67a892b9045089159f210e7db3a80 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-426432803 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-User: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:22 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:25:22 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:25:22 user devstack@n-api.service[61645]: X-User-Id: 6ce33b21c6d541a0a4885680baf52f64 Apr 14 06:25:22 user devstack@n-api.service[61645]: X-User-Name: tempest-AttachVolumeNegativeTest-426432803-project-member Apr 14 06:25:22 user devstack@n-api.service[61645]: method: > Apr 14 06:25:22 user devstack@n-api.service[61645]: exception: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61645]: action_args: {'id': '659408d9-ad86-4482-82dd-710e064e02a1'} Apr 14 06:25:22 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. Apr 14 06:25:22 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:25:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] Returning 404 to user: Instance 659408d9-ad86-4482-82dd-710e064e02a1 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:25:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6b8036d3-0a30-4a5d-8fd1-b2062c56357d tempest-AttachVolumeNegativeTest-426432803 tempest-AttachVolumeNegativeTest-426432803-project-member] 10.0.0.210 "GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1" status: 404 len: 111 microversion: 2.1 time: 0.033048 Apr 14 06:25:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 357/1067] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:22 2023] GET /compute/v2.1/servers/659408d9-ad86-4482-82dd-710e064e02a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=10 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:25:59 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:25:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-47c052ba-2c53-4693-b5b7-ecc9794a888c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1505 microversion: 2.1 time: 0.343828 Apr 14 06:25:59 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 353/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:25:59 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:27:01 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:27:01 user devstack@n-api.service[61644]: Fri Apr 14 06:27:01 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 14 06:27:01 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=10 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:01 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-0f8f465c-4cd9-4e2d-bc32-e50d35d4d95c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: .version_select at 0x7f55c86b8ca0>, body: {"keypair": {"name": "tempest-keypair-1775800648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmp+2NPOMTYQbC0TeVNV78xcjBhWnxOAAiz+5Kq8E4AUhQBHyLfr71LSW1GOPO/tU+sqSS7Vn+9aNFi5is4uVTPrq56e288v5bMFKL6YTLPIzYlIJ/BkHABIlfFUKZgeQ=="}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:27:01 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-0f8f465c-4cd9-4e2d-bc32-e50d35d4d95c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:27:01 user devstack@n-api.service[61644]: DEBUG nova.quota [None req-0f8f465c-4cd9-4e2d-bc32-e50d35d4d95c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for user 67c2d41a3a2e40a3bc67feafbfe4f5ca and project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'key_pairs'} {{(pid=61644) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:27:02 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-0f8f465c-4cd9-4e2d-bc32-e50d35d4d95c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061510 Apr 14 06:27:02 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 359/1069] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:27:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:27:03 user devstack@n-api.service[61645]: ERROR oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 06:27:03 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:27:03 user devstack@n-api.service[61645]: Fri Apr 14 06:27:03 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 06:27:03 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:03 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=12 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:03 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-46421142", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "fa1bd7e5-13e4-45fc-bb2a-6455917df1a5"}], "security_groups": [{"name": "tempest-securitygroup--277839494"}], "key_name": "tempest-keypair-1775800648", "user_data": "}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:27:03 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] validate_networks() for [('fa1bd7e5-13e4-45fc-bb2a-6455917df1a5', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:27:04 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41736. Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:05 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:27:05 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Getting quotas for user 67c2d41a3a2e40a3bc67feafbfe4f5ca and project a6d89d9d942e49ecab2a2449b275fa7e. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:27:05 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:27:05 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:27:05 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3ebd7afe-7da0-424d-ba7b-95c0333e78e4 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.328235 Apr 14 06:27:05 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 358/1070] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:27:03 2023] POST /compute/v2.1/servers => generated 406 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:27:05 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:05 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:05 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8b137b20-2036-41df-97f1-5cefc654b771 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:27:05 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8b137b20-2036-41df-97f1-5cefc654b771 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:27:05 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-8b137b20-2036-41df-97f1-5cefc654b771 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:27:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8b137b20-2036-41df-97f1-5cefc654b771 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1238 microversion: 2.1 time: 0.082185 Apr 14 06:27:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 354/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:27:05 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:27:07 user devstack@n-api.service[61644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 06:27:07 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:27:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:07 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] Creating event network-changed:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:27:07 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ca629761-444c-4b0b-834d-ebd7ce9721dd req-36b37cef-527a-43d3-aec3-473c2fa39422 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031871 Apr 14 06:27:07 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 360/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:27:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:27:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:27:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:27:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c56c5ad2-3bf0-45f0-9830-6ddd82c9c7a7 req-df972bd6-7c70-4fe0-b549-58adec0961b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048945 Apr 14 06:27:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 359/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:27:12 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:27:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:12 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:27:12 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-11ae34c3-4777-4de3-a45d-cbeee9e727eb req-65f54ca7-b1db-4989-af0a-9801a7566ed9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034803 Apr 14 06:27:12 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 355/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:27:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:27:55 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38870. Apr 14 06:27:55 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:27:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-b0649435-aab9-4993-acf3-3a950c6713c2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1551 microversion: 2.1 time: 0.239050 Apr 14 06:27:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 361/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:27:55 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1551 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:55 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:28:55 user devstack@n-api.service[61645]: Fri Apr 14 06:28:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface (ip 10.0.0.210) !!! Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:28:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:28:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-3bd60011-3103-46d4-a53b-7d3ae01f917b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.129325 Apr 14 06:28:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 360/1076] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:28:55 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface => generated 282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:56 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:28:56 user devstack@n-api.service[61646]: Fri Apr 14 06:28:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:28:56 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:28:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] Creating event network-changed:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:28:56 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-fa360cf4-cf93-408f-96c0-fc7eef6e3ef3 req-8d71c576-da30-4145-aef8-9af3e1e27482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048767 Apr 14 06:28:56 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 356/1077] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:28:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8a7e32f-932b-4a35-9446-4e329f0bfe5d"}} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:28:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:28:57 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a54bdf3a-2430-4d77-aacb-62fd6b841932 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523727 Apr 14 06:28:57 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 362/1078] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 06:28:56 2023] POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:04 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'flavor' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:29:04 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-2ed18a43-57e6-464e-8eda-b6e7d538e9a0 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/action" status: 200 len: 32 microversion: 2.1 time: 0.166768 Apr 14 06:29:04 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 361/1079] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:29:04 2023] POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:04 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:05 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:29:05 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-08e1664c-078b-4a8b-b44c-7095cdff6180 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1722 microversion: 2.1 time: 0.150478 Apr 14 06:29:05 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 357/1080] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:29:04 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:29:05 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-unplugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:29:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:05 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] Creating event network-vif-unplugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:29:05 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-be582729-f871-48c8-a906-08fd1fd29d25 req-a4fcf59d-9f12-4e05-88cb-ecb8f28c7846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040302 Apr 14 06:29:05 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 363/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:29:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:29:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:29:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:29:07 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-0f2a049f-34c1-4705-a05d-ccaea6f2ceab req-9862fbbe-fc8f-4ec7-bc6e-8b459f903769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032158 Apr 14 06:29:07 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 362/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:29:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}, {"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:29:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:29:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:29:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-4ec983a1-1e05-4bf4-8f83-f1e4e02ae723 req-a2ba4700-0d95-4917-98b3-a7154b72056d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029049 Apr 14 06:29:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 358/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:29:55 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:29:55 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-2d1baeda-094d-40b2-8dfd-d67cebc1b625 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1702 microversion: 2.1 time: 0.284647 Apr 14 06:29:55 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 364/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:29:55 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1702 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:30:55 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:30:55 user devstack@n-api.service[61645]: Fri Apr 14 06:30:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d (ip 10.0.0.210) !!! Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HTTP exception thrown: Cannot 'detach_volume' instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 while it is in vm_state rescued Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Request method failure captured: Apr 14 06:30:55 user devstack@n-api.service[61645]: request: DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d HTTP/1.1 Apr 14 06:30:55 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:30:55 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:30:55 user devstack@n-api.service[61645]: Connection: close Apr 14 06:30:55 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:30:55 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:30:55 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:30:55 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:30:55 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOPA40kz1CSkfXkpa41TYTiDmycP5PvUSpqXCy0HaeyGOfap2xFlB788Yn2DI1Hz8sypwqOzUVS9Y6K7a89us9BTRBQfUXoGKi7itENvfA3NTD3xwav7UuDXhasVaAQQT5v1qRqP_-QGMGupuMJGEuN32sds1xkSDtBsmszVPl-kzEyA Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Project-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Tenant-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:30:55 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:30:55 user devstack@n-api.service[61645]: X-User: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:30:55 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:30:55 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:30:55 user devstack@n-api.service[61645]: X-User-Id: 67c2d41a3a2e40a3bc67feafbfe4f5ca Apr 14 06:30:55 user devstack@n-api.service[61645]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:30:55 user devstack@n-api.service[61645]: method: > Apr 14 06:30:55 user devstack@n-api.service[61645]: exception: Cannot 'detach_volume' instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 while it is in vm_state rescued Apr 14 06:30:55 user devstack@n-api.service[61645]: action_args: {'server_id': 'fb1eadc7-04dd-401d-b2dc-1abf8a598487', 'id': 'b8a7e32f-932b-4a35-9446-4e329f0bfe5d'} Apr 14 06:30:55 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 while it is in vm_state rescued Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 while it is in vm_state rescued Apr 14 06:30:55 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:30:55 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Returning 409 to user: Cannot 'detach_volume' instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 while it is in vm_state rescued {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:30:55 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-ae262ecc-c9cd-4df5-afff-abadb2ec1fac tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d" status: 409 len: 152 microversion: 2.1 time: 0.191672 Apr 14 06:30:55 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 363/1085] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:30:55 2023] DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d => generated 152 bytes in 195 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 06:30:55 user devstack@n-api.service[61646]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 06:30:55 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:30:55 user devstack@n-api.service[61646]: Fri Apr 14 06:30:55 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/action (ip 10.0.0.210) !!! Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=10 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-3f436dbf-c68f-44db-be2c-a131a5f030d1 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/action" status: 202 len: 0 microversion: 2.1 time: 0.094890 Apr 14 06:30:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 359/1086] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:30:55 2023] POST /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:55 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:30:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-c5c3b78e-435d-4ee0-86d2-b0323b111da2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1710 microversion: 2.1 time: 0.184586 Apr 14 06:30:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 365/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:30:55 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:30:57 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-unplugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:30:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:57 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] Creating event network-vif-unplugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:30:57 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-723970ff-e93c-4725-9744-adb7312c8c20 req-3d3bb692-b9c7-4f9a-b1d1-c58951c3cd5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085904 Apr 14 06:30:57 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 364/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:30:59 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}, {"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}, {"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:30:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:30:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:30:59 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:30:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:30:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:30:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:30:59 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40972. Apr 14 06:30:59 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-81c93cc6-1b03-4918-862f-84e88aa9a916 req-a0be3af2-48a9-41a4-856c-8acadccc10d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035622 Apr 14 06:30:59 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 360/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:30:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:31:46 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:31:46 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-215d8203-38b1-4006-a4bf-545cf0f22a57 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1716 microversion: 2.1 time: 0.179003 Apr 14 06:31:46 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 366/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:31:46 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1716 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=8 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:46 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:32:46 user devstack@n-api.service[61645]: Fri Apr 14 06:32:46 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface (ip 10.0.0.210) !!! Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:46 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:46 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-eb3a8a09-0b37-4276-b617-a290ee0e8e85 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.135412 Apr 14 06:32:46 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 365/1091] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 06:32:46 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:47 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:32:47 user devstack@n-api.service[61646]: Fri Apr 14 06:32:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:47 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] Creating event network-changed:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:32:47 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-a8c4417e-3b09-40bf-bc1e-789b8b580d16 req-ed6eef94-1ec4-4866-836f-86b911d125d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092219 Apr 14 06:32:47 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 361/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:32:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:32:47 user devstack@n-api.service[61644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:47 user devstack@n-api.service[61644]: DEBUG nova.objects.instance [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lazy-loading 'services' on Instance uuid fb1eadc7-04dd-401d-b2dc-1abf8a598487 {{(pid=61644) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:32:47 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-eb20a82c-0e0b-42cd-9a9c-9adefd988341 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d" status: 202 len: 0 microversion: 2.1 time: 0.224781 Apr 14 06:32:47 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 367/1093] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 06:32:47 2023] DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments/b8a7e32f-932b-4a35-9446-4e329f0bfe5d => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:47 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:47 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-76c732ae-43f9-48d8-9ca4-e9c2a6be060c tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Apr 14 06:32:47 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 366/1094] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:32:47 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:32:49 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:32:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:32:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:32:49 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:32:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] Creating event network-changed:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:32:49 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-05d6bf85-54d0-483f-a5e9-3d5f21f9dc80 req-d6f724d9-d880-4d34-ad38-cc5d1256f237 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029055 Apr 14 06:32:49 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 362/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:37 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:37 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35394. Apr 14 06:33:37 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-9cab9764-6437-41a6-b7ba-0c1f8e30f429 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060615 Apr 14 06:33:37 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 368/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 06:33:37 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=10 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:37 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 06:33:37 user devstack@n-api.service[61645]: Fri Apr 14 06:33:37 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 (ip 10.0.0.210) !!! Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:37 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:33:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-d8d07160-34b6-495b-a670-427e5a6f1857 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 204 len: 0 microversion: 2.1 time: 0.124678 Apr 14 06:33:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 367/1097] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:33:37 2023] DELETE /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:33:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-1442853e-8eaa-41bc-be2f-0b4b93ae5fd5 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 200 len: 1676 microversion: 2.1 time: 0.284430 Apr 14 06:33:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 363/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:33:38 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 1676 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:33:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-unplugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:33:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] Creating event network-vif-unplugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:33:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-44fe862f-9c6a-453c-aa2d-13fda8a45320 req-488d736b-2652-4c66-a663-12db6300eacc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038704 Apr 14 06:33:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 369/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:33:40 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-plugged", "status": "completed", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}, {"server_uuid": "fb1eadc7-04dd-401d-b2dc-1abf8a598487", "name": "network-vif-deleted", "tag": "97104eed-fe3e-4803-a457-978bfeba469f"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:33:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:33:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:33:40 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:33:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Creating event network-vif-plugged:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:33:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] Creating event network-vif-deleted:97104eed-fe3e-4803-a457-978bfeba469f for instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 on user Apr 14 06:33:40 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e069a940-8abd-4243-8c05-ffb3be1ad339 req-c3843bb1-4c11-4945-be22-9010d5ec0880 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030203 Apr 14 06:33:40 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 368/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: fb1eadc7-04dd-401d-b2dc-1abf8a598487] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:28 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:34:28 user devstack@n-api.service[61646]: Fri Apr 14 06:34:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 (ip 10.0.0.210) !!! Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.wsgi [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HTTP exception thrown: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Request method failure captured: Apr 14 06:34:28 user devstack@n-api.service[61646]: request: GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 HTTP/1.1 Apr 14 06:34:28 user devstack@n-api.service[61646]: Accept: application/json Apr 14 06:34:28 user devstack@n-api.service[61646]: Accept-Encoding: identity Apr 14 06:34:28 user devstack@n-api.service[61646]: Connection: close Apr 14 06:34:28 user devstack@n-api.service[61646]: Content-Length: 0 Apr 14 06:34:28 user devstack@n-api.service[61646]: Content-Type: application/json Apr 14 06:34:28 user devstack@n-api.service[61646]: Host: 10.0.0.210 Apr 14 06:34:28 user devstack@n-api.service[61646]: Openstack-System-Scope: None Apr 14 06:34:28 user devstack@n-api.service[61646]: User-Agent: python-urllib3/1.26.15 Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Auth-Token: gAAAAABkOPA40kz1CSkfXkpa41TYTiDmycP5PvUSpqXCy0HaeyGOfap2xFlB788Yn2DI1Hz8sypwqOzUVS9Y6K7a89us9BTRBQfUXoGKi7itENvfA3NTD3xwav7UuDXhasVaAQQT5v1qRqP_-QGMGupuMJGEuN32sds1xkSDtBsmszVPl-kzEyA Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Domain-Id: None Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Domain-Name: None Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Identity-Status: Confirmed Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Is-Admin-Project: True Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Project-Domain-Id: default Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Project-Domain-Name: Default Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Project-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Role: member,reader Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Roles: member,reader Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Tenant-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:34:28 user devstack@n-api.service[61646]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:34:28 user devstack@n-api.service[61646]: X-User: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:34:28 user devstack@n-api.service[61646]: X-User-Domain-Id: default Apr 14 06:34:28 user devstack@n-api.service[61646]: X-User-Domain-Name: Default Apr 14 06:34:28 user devstack@n-api.service[61646]: X-User-Id: 67c2d41a3a2e40a3bc67feafbfe4f5ca Apr 14 06:34:28 user devstack@n-api.service[61646]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:34:28 user devstack@n-api.service[61646]: method: > Apr 14 06:34:28 user devstack@n-api.service[61646]: exception: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. Apr 14 06:34:28 user devstack@n-api.service[61646]: action_args: {'id': 'fb1eadc7-04dd-401d-b2dc-1abf8a598487'} Apr 14 06:34:28 user devstack@n-api.service[61646]: {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. Apr 14 06:34:28 user devstack@n-api.service[61646]: ERROR nova.api.openstack.wsgi Apr 14 06:34:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Returning 404 to user: Instance fb1eadc7-04dd-401d-b2dc-1abf8a598487 could not be found. {{(pid=61646) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:34:28 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-9f108615-05d8-4e5e-9c02-5f2c3444c74a tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487" status: 404 len: 111 microversion: 2.1 time: 0.038665 Apr 14 06:34:28 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 364/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:34:28 2023] GET /compute/v2.1/servers/fb1eadc7-04dd-401d-b2dc-1abf8a598487 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:34:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=8 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-22c3ff60-a79f-4b10-b128-00f94f3dd4f6 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '.version_select at 0x7f55c866fd00>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:34:28 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-22c3ff60-a79f-4b10-b128-00f94f3dd4f6 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775800648" status: 202 len: 0 microversion: 2.1 time: 0.039118 Apr 14 06:34:28 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 370/1102] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 06:34:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775800648 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:38 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:34:38 user devstack@n-api.service[61645]: Fri Apr 14 06:34:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 (ip 10.0.0.210) !!! Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:38 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:34:38 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-c640a82b-baba-4f17-a5c7-40ec87c186f2 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 204 len: 0 microversion: 2.1 time: 0.139051 Apr 14 06:34:38 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 369/1103] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:34:38 2023] DELETE /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:38 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:34:38 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-17478c08-9e67-4e72-b744-5337310dde7b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 200 len: 1495 microversion: 2.1 time: 0.279297 Apr 14 06:34:38 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 365/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:34:38 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 1495 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:34:38 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:34:38 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-unplugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:34:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:38 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] Creating event network-vif-unplugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:34:38 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e8403658-b694-4c25-90bd-483ed4149adf req-c7d8d914-bdb2-4867-9ab5-5dc15ed5f3a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106313 Apr 14 06:34:38 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 371/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:34:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:34:39 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-deleted", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:34:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:39 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] Creating event network-vif-deleted:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:34:39 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-37d6e992-6a78-4be6-8efd-de7d7a2efe55 req-ed7f5b8d-d300-4cd3-87e6-0cebcac15716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029483 Apr 14 06:34:39 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 370/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:34:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:34:40 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf8ae21-6690-4390-9990-690333025c17", "name": "network-vif-plugged", "status": "completed", "tag": "47437095-940c-4fcc-bc27-5c8698e99a59"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:34:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:34:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:34:40 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:34:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] Creating event network-vif-plugged:47437095-940c-4fcc-bc27-5c8698e99a59 for instance 6cf8ae21-6690-4390-9990-690333025c17 on user Apr 14 06:34:40 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-2c7cccb3-839b-4d3c-95a2-b8cbffc8e94f req-642a1ec6-cec4-43d0-9c69-8173f2efdb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054300 Apr 14 06:34:40 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 366/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:34:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:35:28 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:35:28 user devstack@n-api.service[61644]: Fri Apr 14 06:35:28 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 (ip 10.0.0.210) !!! Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: 6cf8ae21-6690-4390-9990-690333025c17] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:28 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HTTP exception thrown: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Request method failure captured: Apr 14 06:35:28 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 HTTP/1.1 Apr 14 06:35:28 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:35:28 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:35:28 user devstack@n-api.service[61644]: Connection: close Apr 14 06:35:28 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:35:28 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:35:28 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:35:28 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:35:28 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOPA40kz1CSkfXkpa41TYTiDmycP5PvUSpqXCy0HaeyGOfap2xFlB788Yn2DI1Hz8sypwqOzUVS9Y6K7a89us9BTRBQfUXoGKi7itENvfA3NTD3xwav7UuDXhasVaAQQT5v1qRqP_-QGMGupuMJGEuN32sds1xkSDtBsmszVPl-kzEyA Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Project-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Tenant-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:35:28 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:35:28 user devstack@n-api.service[61644]: X-User: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:35:28 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:35:28 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:35:28 user devstack@n-api.service[61644]: X-User-Id: 67c2d41a3a2e40a3bc67feafbfe4f5ca Apr 14 06:35:28 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:35:28 user devstack@n-api.service[61644]: method: > Apr 14 06:35:28 user devstack@n-api.service[61644]: exception: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. Apr 14 06:35:28 user devstack@n-api.service[61644]: action_args: {'id': '6cf8ae21-6690-4390-9990-690333025c17'} Apr 14 06:35:28 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. Apr 14 06:35:28 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:35:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Returning 404 to user: Instance 6cf8ae21-6690-4390-9990-690333025c17 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:35:28 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-a63a1e51-1906-4592-ab8e-ac197506328f tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17" status: 404 len: 111 microversion: 2.1 time: 0.161142 Apr 14 06:35:28 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 372/1108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:35:28 2023] GET /compute/v2.1/servers/6cf8ae21-6690-4390-9990-690333025c17 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:28 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:35:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8987fdcd-af6d-463f-9426-f9afb736d4fe tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 204 len: 0 microversion: 2.1 time: 0.126882 Apr 14 06:35:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 371/1109] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:35:28 2023] DELETE /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=10 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:28 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:29 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c2d41a3a2e40a3bc67feafbfe4f5ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d89d9d942e49ecab2a2449b275fa7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:35:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-f74eb49e-ca34-4197-b54e-e2930263922b tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 200 len: 1511 microversion: 2.1 time: 0.215558 Apr 14 06:35:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 367/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:35:28 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:35:29 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-unplugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:35:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:29 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] Creating event network-vif-unplugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:35:29 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-0f527f5b-8375-420e-8698-a82e0d10f511 req-06203cb4-5032-4625-a3b9-9a80688c883a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033946 Apr 14 06:35:29 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 373/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:35:30 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-deleted", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:35:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:30 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:30 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] Creating event network-vif-deleted:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:35:30 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-26cf8243-1d5e-42b0-9a21-896f118ed7dd req-50d44905-b956-44f0-8b81-308582c9c8a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034924 Apr 14 06:35:30 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 372/1112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:35:31 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc258d3-78b8-4f61-a648-6452dcc62355", "name": "network-vif-plugged", "status": "completed", "tag": "6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:35:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:35:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:35:31 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:35:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] Creating event network-vif-plugged:6f7f3c2e-3ea9-4bc0-9586-2bd9d101f230 for instance edc258d3-78b8-4f61-a648-6452dcc62355 on user Apr 14 06:35:31 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-14813dfb-5020-4b0e-a7a0-62ae7b5f9091 req-6a4f249b-49ed-4ad5-80dd-24e4725aab83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Apr 14 06:35:31 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 368/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] [instance: edc258d3-78b8-4f61-a648-6452dcc62355] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] HTTP exception thrown: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Request method failure captured: Apr 14 06:36:19 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 HTTP/1.1 Apr 14 06:36:19 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:36:19 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:36:19 user devstack@n-api.service[61644]: Connection: close Apr 14 06:36:19 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:36:19 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:36:19 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:36:19 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:36:19 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOPA40kz1CSkfXkpa41TYTiDmycP5PvUSpqXCy0HaeyGOfap2xFlB788Yn2DI1Hz8sypwqOzUVS9Y6K7a89us9BTRBQfUXoGKi7itENvfA3NTD3xwav7UuDXhasVaAQQT5v1qRqP_-QGMGupuMJGEuN32sds1xkSDtBsmszVPl-kzEyA Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Project-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6d89d9d942e49ecab2a2449b275fa7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Tenant-Id: a6d89d9d942e49ecab2a2449b275fa7e Apr 14 06:36:19 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140136450 Apr 14 06:36:19 user devstack@n-api.service[61644]: X-User: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:36:19 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:36:19 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:36:19 user devstack@n-api.service[61644]: X-User-Id: 67c2d41a3a2e40a3bc67feafbfe4f5ca Apr 14 06:36:19 user devstack@n-api.service[61644]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140136450-project-member Apr 14 06:36:19 user devstack@n-api.service[61644]: method: > Apr 14 06:36:19 user devstack@n-api.service[61644]: exception: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. Apr 14 06:36:19 user devstack@n-api.service[61644]: action_args: {'id': 'edc258d3-78b8-4f61-a648-6452dcc62355'} Apr 14 06:36:19 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. Apr 14 06:36:19 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:36:19 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] Returning 404 to user: Instance edc258d3-78b8-4f61-a648-6452dcc62355 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:36:19 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-6d259b4d-20b2-4b82-84ae-aef8bb8897d3 tempest-ServerRescueNegativeTestJSON-140136450 tempest-ServerRescueNegativeTestJSON-140136450-project-member] 10.0.0.210 "GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355" status: 404 len: 111 microversion: 2.1 time: 0.037112 Apr 14 06:36:19 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 374/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:36:19 2023] GET /compute/v2.1/servers/edc258d3-78b8-4f61-a648-6452dcc62355 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1376031392", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "49216dec-e26c-4761-be09-a3fae71b2ef4"}]}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] validate_networks() for [('49216dec-e26c-4761-be09-a3fae71b2ef4', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting quotas for project 4c26ec94b6b8430c93f18d63ff4991f6. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting quotas for user ac6e9308389d4a2e82c417129f92b61f and project 4c26ec94b6b8430c93f18d63ff4991f6. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:36:35 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:36:35 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-7e1725a4-9b15-493c-9547-314c700292c6 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.943507 Apr 14 06:36:35 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 373/1115] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:36:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:36:36 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:36 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:36 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7639b0bc-58a8-4baf-8811-6fb1fe799acf tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:36:36 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7639b0bc-58a8-4baf-8811-6fb1fe799acf tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:36:36 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7639b0bc-58a8-4baf-8811-6fb1fe799acf tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:36:36 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7639b0bc-58a8-4baf-8811-6fb1fe799acf tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5" status: 200 len: 1208 microversion: 2.1 time: 0.082770 Apr 14 06:36:36 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 369/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:36:35 2023] GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:39 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] Creating event network-changed:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:36:39 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-7422273d-88dc-4c9b-a6f9-4120c2cebc43 req-dcf08a8d-a8fe-4396-8d6e-282e41f9d49a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097228 Apr 14 06:36:39 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 375/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:36:41 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "name": "network-vif-plugged", "status": "completed", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:36:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:41 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] Creating event network-vif-plugged:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:36:41 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-6e088838-3211-404c-a67a-124c7765f2f1 req-36f5cb99-7e12-404b-ad2c-4384206110fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040111 Apr 14 06:36:41 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 374/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:36:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:36:43 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "name": "network-vif-plugged", "status": "completed", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:36:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:36:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:36:43 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:36:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] Creating event network-vif-plugged:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:36:43 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-dd97c9b0-589a-4fd0-af65-69a10013797e req-90179f3b-f6a2-413b-a868-dca720015e8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035905 Apr 14 06:36:43 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 370/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:36:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:37:26 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:37:26 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-3f852761-a02b-4301-bd09-3efa80e5d306 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5" status: 200 len: 1486 microversion: 2.1 time: 0.250703 Apr 14 06:37:26 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 376/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:37:26 2023] GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 => generated 1486 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:27 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:38:27 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-8d4b7598-bba2-4345-b34c-9c3f343079fd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5" status: 204 len: 0 microversion: 2.1 time: 0.146800 Apr 14 06:38:27 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 375/1121] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:38:27 2023] DELETE /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:38:27 user devstack@n-api.service[61646]: Fri Apr 14 06:38:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 (ip 10.0.0.210) !!! Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:27 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:38:27 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e9b9a8db-7061-42c2-b97a-1a63f549ba74 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5" status: 200 len: 1492 microversion: 2.1 time: 0.233890 Apr 14 06:38:27 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 371/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:38:27 2023] GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 => generated 1492 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "name": "network-vif-unplugged", "status": "completed", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:27 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] Creating event network-vif-unplugged:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:38:27 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-154c1caa-3b29-426f-8f8f-f29c6d4188dc req-e95ffef6-1d27-4659-8350-a1b98fe8c256 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043217 Apr 14 06:38:27 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 377/1123] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:38:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:38:28 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "name": "network-vif-deleted", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:38:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:28 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] Creating event network-vif-deleted:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:38:28 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-af71c0c3-7478-4612-83a4-f7a97f91d1c4 req-f9c68e33-2f03-453d-8449-408358d48e98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035688 Apr 14 06:38:28 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 376/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:38:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:38:29 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b290e1c-9913-40a0-b56a-cff34ac136d5", "name": "network-vif-plugged", "status": "completed", "tag": "a60861bc-2377-4a40-87be-e251f3f8e4bb"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:38:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:38:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:38:29 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:38:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] Creating event network-vif-plugged:a60861bc-2377-4a40-87be-e251f3f8e4bb for instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 on user Apr 14 06:38:29 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1ad4f831-14bc-498b-aa59-2b835640666a req-84eb3e01-29a6-4e44-b38d-ce03eaf32d07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028881 Apr 14 06:38:29 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 372/1125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:38:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 4b290e1c-9913-40a0-b56a-cff34ac136d5] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] HTTP exception thrown: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Request method failure captured: Apr 14 06:39:17 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 HTTP/1.1 Apr 14 06:39:17 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:39:17 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:39:17 user devstack@n-api.service[61644]: Connection: close Apr 14 06:39:17 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:39:17 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:39:17 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:39:17 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:39:17 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOPRwElZ62_PHVqkrn8MefdVn_UNJ8UtOoVH5fnC-qQanpk0oAZ3EqhwuqO5hSvBPfPoRFZgljbVWbG_W2ng6N-6nI5TzHp7RpDojXl1uRME2xMNxGLiKmHfNKDmtQYkySYs5B7n6qN53P0bL61s_3CJ2vwHhJQRmHnlbZBAiz-taNaY Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Project-Id: 4c26ec94b6b8430c93f18d63ff4991f6 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesActionsTest-1517089725 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesActionsTest-1517089725 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Tenant-Id: 4c26ec94b6b8430c93f18d63ff4991f6 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesActionsTest-1517089725 Apr 14 06:39:17 user devstack@n-api.service[61644]: X-User: tempest-VolumesActionsTest-1517089725-project-member Apr 14 06:39:17 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:39:17 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:39:17 user devstack@n-api.service[61644]: X-User-Id: ac6e9308389d4a2e82c417129f92b61f Apr 14 06:39:17 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesActionsTest-1517089725-project-member Apr 14 06:39:17 user devstack@n-api.service[61644]: method: > Apr 14 06:39:17 user devstack@n-api.service[61644]: exception: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. Apr 14 06:39:17 user devstack@n-api.service[61644]: action_args: {'id': '4b290e1c-9913-40a0-b56a-cff34ac136d5'} Apr 14 06:39:17 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. Apr 14 06:39:17 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:39:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Returning 404 to user: Instance 4b290e1c-9913-40a0-b56a-cff34ac136d5 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:39:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-af793453-259a-434f-8375-581a4505216a tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5" status: 404 len: 111 microversion: 2.1 time: 0.074523 Apr 14 06:39:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 378/1126] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:39:17 2023] GET /compute/v2.1/servers/4b290e1c-9913-40a0-b56a-cff34ac136d5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:39:17 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-966025992", "imageRef": "3644c9ad-79f4-4051-9ff8-56e591db88fa", "flavorRef": "42", "networks": [{"uuid": "49216dec-e26c-4761-be09-a3fae71b2ef4"}]}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:39:17 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:17 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:17 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 06:39:17 user devstack@n-api.service[61645]: Fri Apr 14 06:39:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 06:39:17 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 06:39:17 user devstack@n-api.service[61645]: Fri Apr 14 06:39:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 14 06:39:17 user devstack@n-api.service[61645]: DEBUG nova.network.neutron [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] validate_networks() for [('49216dec-e26c-4761-be09-a3fae71b2ef4', None, None, None, None, None)] {{(pid=61645) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image limits 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Flavor pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Image pref 0:0:0 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.virt.hardware [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61645) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting quotas for project 4c26ec94b6b8430c93f18d63ff4991f6. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Getting quotas for user ac6e9308389d4a2e82c417129f92b61f and project 4c26ec94b6b8430c93f18d63ff4991f6. Resources: {'ram', 'cores', 'instances'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Going to run 1 instances... {{(pid=61645) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:39:18 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3644c9ad-79f4-4051-9ff8-56e591db88fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61645) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:39:18 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-89f78f98-49c8-4720-b38b-19cac0c105bd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.860417 Apr 14 06:39:18 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 377/1127] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:39:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:39:18 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-78652911-856a-4719-bc40-20aea97544dd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:39:18 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-78652911-856a-4719-bc40-20aea97544dd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:39:18 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:18 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:39:18 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-78652911-856a-4719-bc40-20aea97544dd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:39:18 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-78652911-856a-4719-bc40-20aea97544dd tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074" status: 200 len: 1207 microversion: 2.1 time: 0.256374 Apr 14 06:39:18 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 373/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:39:18 2023] GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 => generated 1207 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:39:20 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:39:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:20 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] Creating event network-changed:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:39:20 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-5540b4c3-ed43-4e95-9dcf-9a6f8e72418b req-bb7ae8d3-2526-4856-9566-d83e9643e2ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045568 Apr 14 06:39:20 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 379/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:39:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:39:22 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "name": "network-vif-plugged", "status": "completed", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:39:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:22 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] Creating event network-vif-plugged:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:39:22 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-de5d68e6-468c-4eb1-afd5-a3cda05c4159 req-91e5133e-04de-44bf-85de-ff9907b29920 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031107 Apr 14 06:39:22 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 378/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:39:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:39:24 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "name": "network-vif-plugged", "status": "completed", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:39:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:39:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:39:24 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:39:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] Creating event network-vif-plugged:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:39:24 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-cd58cbd6-e528-436e-bfc5-35b90907f35d req-a9f7c804-3d5b-4cf8-a6fa-978859647cb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033995 Apr 14 06:39:24 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 374/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:39:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:40:08 user devstack@n-api.service[61644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:40:08 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:40:08 user devstack@n-api.service[61644]: Fri Apr 14 06:40:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 (ip 10.0.0.210) !!! Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:40:08 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:40:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-010ac6a9-c0b5-454f-a33d-83b6f0562a26 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074" status: 200 len: 1486 microversion: 2.1 time: 0.180770 Apr 14 06:40:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 380/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:40:08 2023] GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 => generated 1486 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:41:09 user devstack@n-api.service[61645]: ERROR oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:09 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:41:09 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6059fa48-b6da-48cb-a892-3e035f564993 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074" status: 204 len: 0 microversion: 2.1 time: 0.132219 Apr 14 06:41:09 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 379/1133] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:41:09 2023] DELETE /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:41:09 user devstack@n-api.service[61646]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:41:09 user devstack@n-api.service[61646]: Fri Apr 14 06:41:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 (ip 10.0.0.210) !!! Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:09 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:41:09 user devstack@n-api.service[61644]: Fri Apr 14 06:41:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:41:09 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51582. Apr 14 06:41:09 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac6e9308389d4a2e82c417129f92b61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c26ec94b6b8430c93f18d63ff4991f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:41:09 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-bf3ab7e0-378d-4ee3-98bb-031e8a8b3a91 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074" status: 200 len: 1492 microversion: 2.1 time: 0.247130 Apr 14 06:41:09 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 375/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:41:09 2023] GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 => generated 1492 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "name": "network-vif-unplugged", "status": "completed", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:09 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] Creating event network-vif-unplugged:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:41:09 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-ddbd03d5-939f-4f51-91db-11d1f0385872 req-8281c380-2cdf-4ec4-950f-aad2c8227865 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132840 Apr 14 06:41:09 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 381/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:41:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:41:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "name": "network-vif-deleted", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:41:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] Creating event network-vif-deleted:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:41:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-43da233d-e0bf-4843-b64a-21fa899e3d64 req-21dbd57c-651e-4985-9eb6-a11624b13f09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034184 Apr 14 06:41:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 380/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:41:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eed9fa2-a119-4adf-90ff-2368ee6e8074", "name": "network-vif-plugged", "status": "completed", "tag": "97810044-0533-4e35-8f5d-dc6557f28d36"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:41:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:11 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 35760. Apr 14 06:41:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] Creating event network-vif-plugged:97810044-0533-4e35-8f5d-dc6557f28d36 for instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 on user Apr 14 06:41:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-0ce910a7-0fc7-490f-a717-ad00ea689f30 req-218dc5b3-6919-49ab-ad5d-6bfabb0cd2e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033875 Apr 14 06:41:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 376/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] [instance: 0eed9fa2-a119-4adf-90ff-2368ee6e8074] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:41:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.wsgi [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] HTTP exception thrown: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Request method failure captured: Apr 14 06:41:59 user devstack@n-api.service[61644]: request: GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 HTTP/1.1 Apr 14 06:41:59 user devstack@n-api.service[61644]: Accept: application/json Apr 14 06:41:59 user devstack@n-api.service[61644]: Accept-Encoding: identity Apr 14 06:41:59 user devstack@n-api.service[61644]: Connection: close Apr 14 06:41:59 user devstack@n-api.service[61644]: Content-Length: 0 Apr 14 06:41:59 user devstack@n-api.service[61644]: Content-Type: application/json Apr 14 06:41:59 user devstack@n-api.service[61644]: Host: 10.0.0.210 Apr 14 06:41:59 user devstack@n-api.service[61644]: Openstack-System-Scope: None Apr 14 06:41:59 user devstack@n-api.service[61644]: User-Agent: python-urllib3/1.26.15 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Auth-Token: gAAAAABkOPRwElZ62_PHVqkrn8MefdVn_UNJ8UtOoVH5fnC-qQanpk0oAZ3EqhwuqO5hSvBPfPoRFZgljbVWbG_W2ng6N-6nI5TzHp7RpDojXl1uRME2xMNxGLiKmHfNKDmtQYkySYs5B7n6qN53P0bL61s_3CJ2vwHhJQRmHnlbZBAiz-taNaY Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Domain-Id: None Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Domain-Name: None Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Identity-Status: Confirmed Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Is-Admin-Project: True Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Project-Domain-Id: default Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Project-Domain-Name: Default Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Project-Id: 4c26ec94b6b8430c93f18d63ff4991f6 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Project-Name: tempest-VolumesActionsTest-1517089725 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Role: member,reader Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Roles: member,reader Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4c26ec94b6b8430c93f18d63ff4991f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Tenant: tempest-VolumesActionsTest-1517089725 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Tenant-Id: 4c26ec94b6b8430c93f18d63ff4991f6 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-Tenant-Name: tempest-VolumesActionsTest-1517089725 Apr 14 06:41:59 user devstack@n-api.service[61644]: X-User: tempest-VolumesActionsTest-1517089725-project-member Apr 14 06:41:59 user devstack@n-api.service[61644]: X-User-Domain-Id: default Apr 14 06:41:59 user devstack@n-api.service[61644]: X-User-Domain-Name: Default Apr 14 06:41:59 user devstack@n-api.service[61644]: X-User-Id: ac6e9308389d4a2e82c417129f92b61f Apr 14 06:41:59 user devstack@n-api.service[61644]: X-User-Name: tempest-VolumesActionsTest-1517089725-project-member Apr 14 06:41:59 user devstack@n-api.service[61644]: method: > Apr 14 06:41:59 user devstack@n-api.service[61644]: exception: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. Apr 14 06:41:59 user devstack@n-api.service[61644]: action_args: {'id': '0eed9fa2-a119-4adf-90ff-2368ee6e8074'} Apr 14 06:41:59 user devstack@n-api.service[61644]: {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. Apr 14 06:41:59 user devstack@n-api.service[61644]: ERROR nova.api.openstack.wsgi Apr 14 06:41:59 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] Returning 404 to user: Instance 0eed9fa2-a119-4adf-90ff-2368ee6e8074 could not be found. {{(pid=61644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:41:59 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-856d6085-3466-46b3-be39-5cc17c571145 tempest-VolumesActionsTest-1517089725 tempest-VolumesActionsTest-1517089725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074" status: 404 len: 111 microversion: 2.1 time: 0.084908 Apr 14 06:41:59 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 382/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:41:59 2023] GET /compute/v2.1/servers/0eed9fa2-a119-4adf-90ff-2368ee6e8074 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:43:11 user devstack@n-api.service[61645]: ERROR oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 06:43:11 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:11 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:11 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:43:11 user devstack@n-api.service[61645]: Fri Apr 14 06:43:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 14 06:43:11 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:43:11 user devstack@n-api.service[61645]: Fri Apr 14 06:43:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 14 06:43:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cda000b9-a429-4afc-bb37-d959e1746241 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Action: 'create', calling method: .version_select at 0x7f55e27c6f80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1686517600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs1znS8wdd1kcIr9Yz2SWdAc4SAXfKNKRmXHNZYoNVZ42v7a1PiR3v0nEJS6l4GXfjbbAkPUJOxugMIERB4Y9v+RLgB9bXsarGFK8hQyzHoBdnf+HGGWrHMzSVajIRcwg=="}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:43:11 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-cda000b9-a429-4afc-bb37-d959e1746241 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting quotas for project f236d920caec41629c6f9961bd5a9e05. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:43:11 user devstack@n-api.service[61645]: DEBUG nova.quota [None req-cda000b9-a429-4afc-bb37-d959e1746241 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting quotas for user 9ac336d9af104cc9b1d47595b06a5fd6 and project f236d920caec41629c6f9961bd5a9e05. Resources: {'key_pairs'} {{(pid=61645) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:43:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-cda000b9-a429-4afc-bb37-d959e1746241 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262386 Apr 14 06:43:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 381/1139] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 06:43:11 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:43:16 user devstack@n-api.service[61646]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] AMQP server on 10.0.0.210:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 14 06:43:16 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:16 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=8 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:16 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-502729280", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1686517600", "security_groups": [{"name": "tempest-secgroup-smoke-5473957"}], "networks": [{"uuid": "d5bcea10-de7e-4537-9435-c1b35870e5d3"}], "block_device_mapping_v2": [{"uuid": "18c968fc-710d-4734-bfd9-ef5071c5364b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:43:16 user devstack@n-api.service[61646]: DEBUG nova.network.neutron [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] validate_networks() for [('d5bcea10-de7e-4537-9435-c1b35870e5d3', None, None, None, None, None)] {{(pid=61646) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image limits 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Flavor pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Image pref 0:0:0 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.virt.hardware [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting quotas for project f236d920caec41629c6f9961bd5a9e05. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.quota [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Getting quotas for user 9ac336d9af104cc9b1d47595b06a5fd6 and project f236d920caec41629c6f9961bd5a9e05. Resources: {'ram', 'cores', 'instances'} {{(pid=61646) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Going to run 1 instances... {{(pid=61646) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 06:43:17 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18c968fc-710d-4734-bfd9-ef5071c5364b',volume_size=None,volume_type=None)] {{(pid=61646) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 06:43:17 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-a5d34aff-5890-4f28-a4d9-dd6ea776257b tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.856678 Apr 14 06:43:17 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 377/1140] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 06:43:16 2023] POST /compute/v2.1/servers => generated 401 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 06:43:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:17 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:17 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:43:17 user devstack@n-api.service[61644]: Fri Apr 14 06:43:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 (ip 10.0.0.210) !!! Apr 14 06:43:17 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-e77033fd-5944-4b0a-870e-5cd834ea20ee tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:43:17 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-e77033fd-5944-4b0a-870e-5cd834ea20ee tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:43:17 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-e77033fd-5944-4b0a-870e-5cd834ea20ee tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:43:17 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-e77033fd-5944-4b0a-870e-5cd834ea20ee tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1083 microversion: 2.1 time: 0.130113 Apr 14 06:43:17 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 383/1141] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:43:17 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1083 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:43:19 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49318. Apr 14 06:43:19 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:43:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:43:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:43:19 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:43:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] Creating event network-changed:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:43:19 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-e9df4cf4-3741-451f-918f-5a5f51c770d9 req-82dd59af-000b-45ca-b7bb-4a34cac4ed03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087145 Apr 14 06:43:19 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 382/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:43:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:43:26 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c98f28e-6512-4061-b118-66c663c57876] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 49320. Apr 14 06:43:26 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:43:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:43:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:43:26 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:43:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:43:26 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-ee019960-e70f-4969-b350-17b83189ef7e req-e54400a2-ab8b-4fd0-8d9d-bd407bda7ba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112803 Apr 14 06:43:26 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 378/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:43:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell0:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:43:28 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:43:28 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:43:28 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-de27bd4c-595a-4105-b6b8-5ad172937f5a req-ecd41fe6-e666-4a87-bfa7-50b2146712e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Apr 14 06:43:28 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 384/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:43:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell0:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:44:07 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:44:08 user devstack@n-api.service[61645]: DEBUG nova.policy [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61645) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:44:08 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-42fb9033-4185-4b7c-a1c4-6219474ac3aa tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1431 microversion: 2.1 time: 0.390031 Apr 14 06:44:08 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 383/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:44:07 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1431 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell0:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:08 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:45:08 user devstack@n-api.service[61646]: Fri Apr 14 06:45:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 (ip 10.0.0.210) !!! Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:08 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:45:08 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-7431c592-4e11-4383-b0e3-226f22429370 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1431 microversion: 2.1 time: 0.303409 Apr 14 06:45:08 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 379/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:45:08 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1431 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:45:10 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:10 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] Creating event network-changed:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-6f45efc9-bb46-4c07-99c5-0cbb42a7ed48 req-b8a15295-8c19-4c6c-9c4e-c85a7ddc9277 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092640 Apr 14 06:45:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 385/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:45:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=6 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61645]: DEBUG nova.objects.instance [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lazy-loading 'flavor' on Instance uuid c456cdfd-6989-4fcb-a60b-cbc8cc592f43 {{(pid=61645) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 06:45:11 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-606ad1e5-d6ba-4326-81c1-616b0a2971a0 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/action" status: 202 len: 0 microversion: 2.1 time: 0.113926 Apr 14 06:45:11 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 384/1148] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:45:11 2023] POST /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:45:11 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-4b1014ce-3083-4378-b347-ad88e007083d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1437 microversion: 2.1 time: 0.212012 Apr 14 06:45:11 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 380/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:45:11 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1437 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-unplugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:11 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] Creating event network-vif-unplugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:11 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e0e6259a-4158-4763-afe0-16d51593c764 req-ba511371-301c-4f60-a715-bacc54a68d76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087482 Apr 14 06:45:11 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 386/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:45:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:45:13 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:45:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:13 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] Creating event network-changed:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-439ff160-8ad1-4f4a-bdc7-f052a6e44273 req-6b9da071-9e2c-46fc-bc37-2a24bca98be8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031155 Apr 14 06:45:13 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 385/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:45:13 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}, {"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}, {"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}, {"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-unplugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}, {"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:45:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:45:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:45:13 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Creating event network-vif-unplugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:45:13 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1ca966ed-e9c5-449c-9376-23e43b13b60b req-107a9503-b73a-439e-92c3-6a7ca0d65a40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.052710 Apr 14 06:45:13 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 381/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:45:13 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=4 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:46:01 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:46:01 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-3560e72a-1419-4221-a645-342cb3b20b23 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1497 microversion: 2.1 time: 0.277173 Apr 14 06:46:01 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 387/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:46:01 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=4 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:01 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:02 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61645) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 06:47:02 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-59c649b9-1020-4483-9c6a-b1fb347240fd tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/action" status: 202 len: 0 microversion: 2.1 time: 0.353814 Apr 14 06:47:02 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 386/1154] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 06:47:01 2023] POST /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 06:47:02 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:47:02 user devstack@n-api.service[61646]: Fri Apr 14 06:47:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 (ip 10.0.0.210) !!! Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=14 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG nova.compute.api [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61646) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:02 user devstack@n-api.service[61646]: DEBUG nova.policy [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61646) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:47:02 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-8f9d8658-418e-4501-86b7-f652fdfd69e6 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1505 microversion: 2.1 time: 0.194751 Apr 14 06:47:02 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 382/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:47:02 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:47:08 user devstack@n-api.service[61644]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:08 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:47:08 user devstack@n-api.service[61644]: Fri Apr 14 06:47:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:47:08 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:47:08 user devstack@n-api.service[61644]: Fri Apr 14 06:47:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:08 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] Creating event network-changed:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:47:08 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-e55aed5c-7fbf-4402-ac1d-9360cdf356d2 req-cc2c1bb0-9131-47d2-9ed9-dc15c24353a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043819 Apr 14 06:47:08 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 388/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=6,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:12 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:47:12 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-6af5ff6b-fe29-493f-960e-117de26a9b95 req-f43f074e-a170-483a-b7ff-282ea10539cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055794 Apr 14 06:47:12 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 387/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:47:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=6 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:14 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:47:14 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-8f30f83a-6e5e-4eb0-a1f5-442fa12e5cfd req-577fd4bd-c715-45e7-948f-b63b3c066273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088927 Apr 14 06:47:14 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 383/1158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:47:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:47:52 user devstack@n-api.service[61644]: INFO oslo.messaging._drivers.impl_rabbit [-] [a237f721-ff94-49d6-83cc-5a6fc75ae8d1] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47800. Apr 14 06:47:52 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:47:52 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-186ef53e-8b5d-4a83-bd98-69059a917987 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1550 microversion: 2.1 time: 0.175361 Apr 14 06:47:52 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 389/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:47:52 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:48:53 user devstack@n-api.service[61645]: ERROR oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 06:48:53 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:48:53 user devstack@n-api.service[61645]: Fri Apr 14 06:48:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 (ip 10.0.0.210) !!! Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=2 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:53 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Going to try to terminate instance {{(pid=61645) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 06:48:53 user devstack@n-api.service[61646]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 06:48:53 user devstack@n-api.service[61646]: Fri Apr 14 06:48:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 06:48:53 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:53 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=2 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:54 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:48:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-6cfc76bd-813f-4849-8883-3e33e0afd42a tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 204 len: 0 microversion: 2.1 time: 0.156796 Apr 14 06:48:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 388/1160] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 06:48:53 2023] DELETE /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_api:SELECT=2 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG dbcounter [-] [61644] Writing DB stats nova_cell1:SELECT=6 {{(pid=61644) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:54 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG nova.compute.api [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61644) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] Creating event network-changed:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:48:54 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-1bed771b-2b2b-4fca-a6d8-80602b980c06 req-2784f256-dd29-41e6-9bcf-22a641cf6d13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116723 Apr 14 06:48:54 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 384/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:48:54 user devstack@n-api.service[61644]: DEBUG nova.policy [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac336d9af104cc9b1d47595b06a5fd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f236d920caec41629c6f9961bd5a9e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61644) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 06:48:54 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [None req-005300cf-acb1-447f-921d-575fdf734ecf tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 200 len: 1556 microversion: 2.1 time: 0.200826 Apr 14 06:48:54 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 390/1162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:48:54 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 06:48:54 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-unplugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:54 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.compute.server_external_events [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] Creating event network-vif-unplugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:48:54 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [req-c2760c5a-3480-49ce-bdf1-55695d929bd0 req-07334846-e054-4516-977c-e6c2cac9f184 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029275 Apr 14 06:48:54 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 389/1163] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:48:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:48:55 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-deleted", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:48:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:55 user devstack@n-api.service[61646]: DEBUG oslo_concurrency.lockutils [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61646) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.compute.server_external_events [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] Creating event network-vif-deleted:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:48:55 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [req-9f3dbe1b-cf17-4e58-bf23-3cccd0787d7c req-b1e6a82c-7171-4931-9104-f0ff42f6a0be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030982 Apr 14 06:48:55 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 385/1164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:48:56 user devstack@n-api.service[61644]: DEBUG nova.api.openstack.wsgi [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c456cdfd-6989-4fcb-a60b-cbc8cc592f43", "name": "network-vif-plugged", "status": "completed", "tag": "1f36038c-c21c-4283-8e87-62f069837cc4"}]} {{(pid=61644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 06:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:48:56 user devstack@n-api.service[61644]: DEBUG oslo_concurrency.lockutils [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61644) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:48:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.compute.server_external_events [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] Creating event network-vif-plugged:1f36038c-c21c-4283-8e87-62f069837cc4 for instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 on user Apr 14 06:48:56 user devstack@n-api.service[61644]: INFO nova.api.openstack.requestlog [req-9289e778-9b84-40ae-aec1-f2592cf33165 req-d5b4c1b1-aa63-45ac-ae8d-0191f095cfae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028814 Apr 14 06:48:56 user devstack@n-api.service[61644]: [pid: 61644|app: 0|req: 391/1165] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 06:48:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '>' {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG nova.compute.api [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] [instance: c456cdfd-6989-4fcb-a60b-cbc8cc592f43] Fetching instance by UUID {{(pid=61645) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG dbcounter [-] [61645] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61645) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:49:44 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 06:49:44 user devstack@n-api.service[61645]: Fri Apr 14 06:49:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 (ip 10.0.0.210) !!! Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Acquiring lock "04c347fb-2af4-49ec-9923-e49099926d59" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG oslo_concurrency.lockutils [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Lock "04c347fb-2af4-49ec-9923-e49099926d59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61645) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 06:49:44 user devstack@n-api.service[61645]: INFO oslo.messaging._drivers.impl_rabbit [-] [313f1aaf-43ae-49b9-884f-c75b3e4fad3a] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 60484. Apr 14 06:49:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.wsgi [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] HTTP exception thrown: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Request method failure captured: Apr 14 06:49:44 user devstack@n-api.service[61645]: request: GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 HTTP/1.1 Apr 14 06:49:44 user devstack@n-api.service[61645]: Accept: application/json Apr 14 06:49:44 user devstack@n-api.service[61645]: Accept-Encoding: identity Apr 14 06:49:44 user devstack@n-api.service[61645]: Connection: close Apr 14 06:49:44 user devstack@n-api.service[61645]: Content-Length: 0 Apr 14 06:49:44 user devstack@n-api.service[61645]: Content-Type: application/json Apr 14 06:49:44 user devstack@n-api.service[61645]: Host: 10.0.0.210 Apr 14 06:49:44 user devstack@n-api.service[61645]: Openstack-System-Scope: None Apr 14 06:49:44 user devstack@n-api.service[61645]: User-Agent: python-urllib3/1.26.15 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Auth-Token: gAAAAABkOPX4eCVtvJthAzObB97EfVbsa_D0yOLnTXxhgS_lXxq4F57pDW7cX6kQI3VGn9keIin3Ez0nSe0iAtXzDEtDpKoMnr2DsbDRNWgAqBK6YdhMIRIDchhS-3eQOmEmz6eqRejDbB1pfn7FhT2rgb25o_Ul2lr3fes-DpSRZK6GH2wkhhI Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Domain-Id: None Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Domain-Name: None Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Identity-Status: Confirmed Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Is-Admin-Project: True Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Project-Domain-Id: default Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Project-Domain-Name: Default Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Project-Id: f236d920caec41629c6f9961bd5a9e05 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Project-Name: tempest-TestShelveInstance-536046863 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Role: member,reader Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Roles: member,reader Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f236d920caec41629c6f9961bd5a9e05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f236d920caec41629c6f9961bd5a9e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f236d920caec41629c6f9961bd5a9e05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}] Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Tenant: tempest-TestShelveInstance-536046863 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Tenant-Id: f236d920caec41629c6f9961bd5a9e05 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-Tenant-Name: tempest-TestShelveInstance-536046863 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-User: tempest-TestShelveInstance-536046863-project-member Apr 14 06:49:44 user devstack@n-api.service[61645]: X-User-Domain-Id: default Apr 14 06:49:44 user devstack@n-api.service[61645]: X-User-Domain-Name: Default Apr 14 06:49:44 user devstack@n-api.service[61645]: X-User-Id: 9ac336d9af104cc9b1d47595b06a5fd6 Apr 14 06:49:44 user devstack@n-api.service[61645]: X-User-Name: tempest-TestShelveInstance-536046863-project-member Apr 14 06:49:44 user devstack@n-api.service[61645]: method: > Apr 14 06:49:44 user devstack@n-api.service[61645]: exception: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. Apr 14 06:49:44 user devstack@n-api.service[61645]: action_args: {'id': 'c456cdfd-6989-4fcb-a60b-cbc8cc592f43'} Apr 14 06:49:44 user devstack@n-api.service[61645]: {{(pid=61645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. Apr 14 06:49:44 user devstack@n-api.service[61645]: ERROR nova.api.openstack.wsgi Apr 14 06:49:44 user devstack@n-api.service[61645]: DEBUG nova.api.openstack.wsgi [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Returning 404 to user: Instance c456cdfd-6989-4fcb-a60b-cbc8cc592f43 could not be found. {{(pid=61645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 06:49:44 user devstack@n-api.service[61645]: INFO nova.api.openstack.requestlog [None req-cee430d4-2c73-4184-8bde-35e11406b034 tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43" status: 404 len: 111 microversion: 2.1 time: 0.045370 Apr 14 06:49:44 user devstack@n-api.service[61645]: [pid: 61645|app: 0|req: 390/1166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 06:49:44 2023] GET /compute/v2.1/servers/c456cdfd-6989-4fcb-a60b-cbc8cc592f43 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 06:49:44 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_api:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:49:44 user devstack@n-api.service[61646]: DEBUG dbcounter [-] [61646] Writing DB stats nova_cell1:SELECT=4 {{(pid=61646) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 06:49:44 user devstack@n-api.service[61646]: DEBUG nova.api.openstack.wsgi [None req-e695ec48-a28c-4c30-806a-107703e62c3d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] Calling method '.version_select at 0x7f55e2ee9ab0>' {{(pid=61646) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 06:49:44 user devstack@n-api.service[61646]: INFO nova.api.openstack.requestlog [None req-e695ec48-a28c-4c30-806a-107703e62c3d tempest-TestShelveInstance-536046863 tempest-TestShelveInstance-536046863-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1686517600" status: 202 len: 0 microversion: 2.1 time: 0.040391 Apr 14 06:49:44 user devstack@n-api.service[61646]: [pid: 61646|app: 0|req: 386/1167] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 06:49:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1686517600 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)